Systems and methods for intelligent automation control services

ABSTRACT

Aspects of the disclosure relate to intelligent automation control of an environment based at least on intelligence associated with behavior of an operator and/or equipment.

CROSS-REFERENCE TO RELATED APPLICATION

This patent application is related to and claims priority from U.S.Provisional Patent Application No. 61/986,080, filed Apr. 29, 2014, thecontent of which is hereby incorporated by reference herein in itsentirety.

This application is also related to application Ser. No. ______, filedconcurrently with the present application on ______, entitled: “SYSTEMSAND METHODS FOR INTELLIGENT CUSTOMIZATION OF AN AUTOMATION CONTROLSERVICE;” application Ser. No. ______, filed concurrently with thepresent application on ______, entitled: “SYSTEMS AND METHODS FORAUTONOMOUS ADAPTATION OF AN AUTOMATION CONTROL SERVICE;” and applicationSer. No. ______, filed concurrently with the present application on______, entitled: “SYSTEMS AND METHODS FOR DEVELOPMENT OF AN AUTOMATIONCONTROL SERVICE;” the contents of which are hereby incorporated byreference in their entireties.

SUMMARY

This summary presents a simplified, rather than extensive, overview ofthe disclosure in order to provide a basic understanding of some aspectsthereof. In addition, this summary is not intended to identify key orcritical elements of the disclosure or delineate any scope thereof.Instead, this summary presents certain principles of the disclosure in asimplified form as a prelude to the more extensive detailed descriptionthat is included in the present specification.

The disclosure generally relates, in at least certain aspects, toconsumer-centric intelligent automation control. Such intelligentautomation control can rely upon or otherwise leverage at least threefunctional elements: (1) a gateway device that can recognize devicesand/or sensors, and connectivity standards in order to deliver managedautomation control services. The gateway device can have varying degreesof complexity and, in certain embodiments, the gateway device can beembodied in or can include a unit that sends traffic and/or signaling toa backend network or a computing device thereof (such as a networkelement or a “cloud” element) where at least a portion of the trafficand/or signaling can be processed or otherwise managed. (2) A suite ofautomation control services that can be provided in a cloud arrangementor are otherwise distributed in a networked configuration. An automationcontrol service can include assets (referred to as “automation controlassets), such as hardware, firmware, and/or software. As such, anautomation control service can include physical components and/orsoftware components. In certain embodiments, an automation control assetcan include a device that can operate within a controlled environment,(3) A dynamic library or supply of customizable service settings (whichmay be referred to as “modes”) associated with an automation controlservice and/or an automation control asset. In one aspect, automationcontrol assets and/or related modes can be developed by a community ofusers via a development platform and related portal that can permitsharing and/or discovering new configuration of connected services anddevices within a controlled environment.

The disclosed automation control can be based on learned behavior(s) ofthe consumer and, in one aspect, can be dynamic or otherwise evolve ontime. Intelligence associated with such behaviors can be gleaned from orotherwise based on information (e.g., data, metadata, and/or signaling)obtained from one or more devices disposed within a controlledenvironment (e.g., a confined region of space) or in proximity thereof.Networked automation control services and/or assets can permitimplementation of one or more control sequences associated with at leastone of the. In one example, an automation control asset can have one ormore modes associated therewith, where a mode can be include a specificconfiguration of tasks and/or operations to be performed by device(s)and/or sensor(s) associated with a controlled environment (e.g., adwelling, such as single-family unit or multi-dwelling unit; a factoryor other industrial spaces; an office building or other commercialspaces; or the like). Automation control assets or modes thereof can bedeveloped within a platform associated with a provider of services(e.g., voice, data, and the like) consumed within the controlledenvironment. In one example, a mode can be germane to an automationcontrol asset or can be a hybrid between modes associated with two ormore automation control assets. The modes can be developed autonomously,automatically, and/or manually. In one example, autonomously generatedor otherwise updated modes can be produced automatically and/or based atleast on learned behaviors associated with the controlled environment.In addition or in the alternative, a third-party can develop such assetsand/or modes. A portal referred to as a marketplace can expose availableautomation control service(s) and/or asset(s), and can permittransactions between a consumer or prospective consumers and a platformthat provides such service(s) and/or asset(s).

In at least certain aspects of intelligent automation control services,embodiments of the disclosure permit generation and/or recommendation ofautomation control services based on learned behaviors of agentsassociated with an environment to be controlled (e.g., a residence, abusiness office, a hotel, a factory, or the like). An agent can be ahuman or a non-human entity, such as a device, a sensor, a softwareapplication in execution (e.g., a web service), an information structure(e.g., user input) and an associated device, a combination thereof, orthe like. Streams of data, metadata, and/or signaling can be received orotherwise accessed from an agent, and can be conditioned (e.g.,aggregated, filtered, formatted, etc.) for analysis. Raw or conditionedinformation (e.g., data, metadata, and/or signaling) from one or moreagents can be analyzed to determine or otherwise identify a behavior ofan agent. The behavior can be characterized by (i) sequences of events,such as specific activity of an agent, extracted from the data,metadata, and/or signaling; (ii) patterns in the data, metadata, and/orsignaling; and/or (iii) correlations between patterns. Based on thebehavior, one or more control actions can be determined. The controlaction(s) can be grouped to form an automation control service, whichcan be recommended to an owner or lessee of the environment. Inaddition, the control action(s) can be grouped to form a specific modeof operation of the automation control service. The determined controlaction(s), as either an automation control service or a mode thereof,can be relied upon to direct operation of the agent(s) associated withthe environment to be controlled.

In other aspects, embodiments of the disclosure permit customization ofan automation control service based at least on learned interactivity ofan agent (such as an end-user, a device or sensor) with the service.Streams of data, metadata, and/or signaling can be received or otherwiseaccessed from an agent, and can be conditioned (e.g., aggregated,filtered, formatted, etc.) for analysis. Raw or conditioned information(e.g., data, metadata, and/or signaling) from one or more agents can beanalyzed to learn how an agent interacts with the automation controlservice. Learned interactivity can be characterized by correlationbetween events associated with an agent in a specific control state of acontrol sequence provided by the automation control service and/or aspecific agent state not necessarily related to the control state. Acontrol state can be a condition of a controlled environment (e.g.,temperature of a room and/or light intensity from one or more lightsources) arising from implementation of a control sequence based on theautomation control service. An agent state can be a condition of anagent that arises from activity (e.g., sensing protocol of a sensor,physiological condition of a human agent due to exercise routing, etc.)within a controlled environment, or in response to a specific controlstate. In addition, learned interactivity can be characterized bystructure (e.g., sequence, pattern, etc.) of one or more eventsassociated with the agents at a control state and/or agent state. Basedon the learned interactivity, (A) a specific automation control asset(e.g., a mode; an agent, such a sensor, a device, a softwareapplication; or the like) can be recommended for addition to an existingautomation control service; (B) operation of an agent (e.g., a sensor ora device) of the existing automation control service can be adjusted;and/or (C) an additional automation control service can be recommendedto supplement or complement the existing automation control service. Theadditional automation control service and the existing automationcontrol service can form a new automation control service.

In at least certain aspects of evolution or adaptation of intelligentautomation control, embodiments of the disclosure permit dynamicadaptation of an automation control service in response to a currentenvironment of an agent, thereby providing automation control that maybe optimal or nearly optimal to current operation conditions of theagent. For instance, the automation control service can be adapted inresponse to events, such as activity (historical or contemporaneous) atcertain times of the day; activity (historical or contemporaneous) atcertain times of the week; and/or cumulative activity during apredetermined period, such as intense work week for a human, operationof a heating, ventilation, and air conditioning (HVAC) system duringcertain days with inclement weather, acquired proficiency (e.g.,increased fitness) during certain period, and the like. Streams of data,metadata, and/or signaling can be received or otherwise accessed from anagent, and can be conditioned (e.g., aggregated, filtered, formatted,etc.) for analysis. Raw or conditioned information (e.g., data,metadata, and/or signaling) from one or more agents can be analyzed todetermine a current state of the agent for a current environment of theagent, and/or to learn behavior of the agent in such an environment.Such state, environment, and/or learned behavior can permit modifyingthe automation control service, thereby providing a service that istailored (e.g., optimized or nearly optimized) to the currentenvironment and/or situation of the agent within a controlledenvironment. As such, the automation control service can evolve andautonomously adapt to the agent. The current state of an agent and/orthe environment thereof can be biased (or perturbed) in order to collecta response or feedback (e.g., desirability, popularity, operationalefficiency of a device, or the like) from the agent, and thus, learnwhat control actions may be favorable to (e.g., preferred by) the agentand adapt the automation control service accordingly.

In at least certain aspects of development of automaton controlservices, a common control language and an information model (e.g., datamodel, metadata model, and/or signaling model) can permit composition ofan automation control service without reliance on platform-specificdetails of an automation control asset (e.g., a hardware unit, such as asensor or a device; a software unit, such as control logic).Accordingly, the automation control service can be developed as anabstract platform-agnostic service, and control messages specific to acontrol environment (e.g., a specific control environment, such as aspecific sound system in customer premises) can be provided based onavailable information regarding the control environment. As such, thedisclosed system and methods can obfuscate the complexity of the myriadof underlying technology systems and their settings. Existing automationcontrol services and/or automation control assets (e.g., modes, sensors,devices, etc.) can be dynamically inventoried and exposed fordevelopment of additional automation control services. Similarly,automation control services and/or assets can be discovered for aspecific environment to be controlled. For instance, sensors, devices,and/or other equipment can be discovered for a household in response toprovisioning control services or in response to changes within thehousehold (e.g., deployment of lighting system, changes in HVAC system,media system, etc.). Discovered automation control services and/orassets can be inventoried and exposed for development of new or updatedautomation control services and/or assets. Available automation controlservices and/or assets can be recommended to developers, and can becross-referenced to facilitate further development.

Various features of the disclosure can provide example advantages overconventional automation technologies. For example, certain embodimentsof the disclosure can permit maintaining a focus on the “automation job”or automation task intended or otherwise desired by an end-user. Assuch, devices within an automated environment and/or available to theend-user can permit achieving a desired automation control, rather thandetermining the type of control that can be implemented within theautomated environment. For another example, certain embodiments of thedisclosure can permit intelligent automation control that can be linkedto behavior of the consumer and thus, automation control services and/orassets described herein can be straightforward and/or intuitive to setup, configure, and utilize. For yet another example, certain embodimentsof the disclosure can permit providing intelligent automation controlthat as a managed service, and can leverage numerous functionalities andcapabilities of a networked environment (e.g., WAN(s), LAN(s), and/orother networks), such as security, reliability, etc. Accordingly, theautomation control services and/or assets described herein can leveragecloud principles and/or functionality, and as such, complement devicesand/or network with subscription to automation control services that canbe delivered seamlessly to a controlled environment.

While various aspects of the disclosure are illustrated in connectionwith a home or a dwelling, it should be appreciated that the disclosureis not so restricted and embodiments of the disclosure can be applied toor otherwise leveraged in most any environment having a confined regionof space, including indoors and/or outdoors areas. For example, such anenvironment can be embodied in or can include a multi-dwelling unit, afactory or other industrial space, a business office or other commercialspace, portion of a city or other urban area, a combination of theforegoing, or the like.

Other features and/or advantages of the disclosure will be set forth inpart in the description which follows, and in part will be apparent fromthe description, or may be learned by practice of the disclosure.Certain features and/or advantages of the disclosure may be realized andattained by means of the elements and combinations particularly pointedout in the appended claims. It is to be understood that both theforegoing general description and the following detailed description areexemplary and explanatory only and are not restrictive of the presentdisclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings are an integral part of the disclosure and areincorporated into the subject specification, and illustrate exampleembodiments of the disclosure. The drawings, in conjunction with thesummary, description, and claims serve to explain various principles,features, and/or aspects of the disclosure.

FIG. 1A illustrates customer-centric intelligent automation control inaccordance with one or more embodiments of the disclosure.

FIG. 1B illustrates an example of historical event informationassociated with customer-centric intelligent automation control inaccordance with one or more embodiments of the disclosure.

FIG. 2 illustrates intelligence associated with customer-centricintelligent automation control in accordance with one or moreembodiments of the disclosure.

FIG. 3 illustrates an example operational environment forcustomer-centric intelligent automation control in accordance with oneor more embodiments of the disclosure.

FIG. 4 illustrates an example representation of an automation controlasset in accordance with one or more embodiments of the disclosure.

FIGS. 5A, 5B, 5C, 5D, and 5E illustrate example automation assets inaccordance with one or more embodiments of the disclosure.

FIG. 6 illustrates another example representation of an automationcontrol service in accordance with one or more embodiments of thedisclosure.

FIG. 7 illustrates an example operational environment forcustomer-centric intelligent automation control in accordance with oneor more embodiments of the disclosure.

FIG. 8A illustrate another example operational environment forcustomer-centric intelligent control in accordance with one or moreembodiments of the disclosure.

FIG. 8B illustrates an example of an event engine for customer-centricintelligent control in accordance with one or more embodiments of thedisclosure.

FIG. 8C illustrates an example of a credential manager forcustomer-centric intelligent control in accordance with one or moreembodiments of the disclosure.

FIG. 9 illustrates an example of a business development platform inaccordance with one or more embodiments of the disclosure.

FIGS. 10-11 illustrate examples of an automation orchestration platformin accordance with one or more embodiments of the disclosure.

FIGS. 12-13 illustrate an example computing device associated withcustomer-centric intelligent control in accordance with one or moreembodiments of the disclosure. The example computing device can embodyor can constitute a gateway device in accordance with embodiments of thedisclosure.

FIG. 14 illustrates an example radio unit in accordance with one or moreembodiments of the disclosure.

FIG. 15 illustrates an example of an operational environment fordevelopment of automation control services in accordance with one ormore embodiments of the disclosure.

FIG. 16 illustrates an example of a user interface for configuration ofan automation control service in accordance with one or more embodimentsof the disclosure.

FIGS. 17A and 17B illustrate an example of a data model forconfiguration of an automation control service in accordance with one ormore embodiments of the disclosure. FIG. 17A represents a first portionof the data model and FIG. 17B represents a second portion of the datamodel.

FIG. 18 illustrates an example of an operation environment forutilization of an automation control service configured in accordancewith embodiments of the disclosure.

FIGS. 19-20 illustrate examples of computing environments forcostumer-centric intelligent automation control in accordance with oneor more embodiments of the disclosure.

FIGS. 21-33 illustrate example methods for costumer-centric intelligentautomation control in accordance with one or more embodiments of thedisclosure. While the example techniques illustrated in FIGS. 21-26 and28-32 are conveyed in flowcharts, the example method illustrated in FIG.27 is conveyed in an example process flow comprising examplearchitecture (e.g., device(s), a gateway device, and an orchestrationplatform) that can operate in accordance with one or more aspects of thedisclosure.

DETAILED DESCRIPTION

As utilized in the present disclosure, the term “solution” or “service”can refer to a group of one or more of an infrastructure functionalelement (e.g., a router, a hardware server, a computing device, areference link, or the like), a software application, a firmwareapplication, or a service (such as a business service or aninfrastructure service). The terms “cloud solution” refer to a solutionthat is deployed in the cloud or a wide area network (e.g., a backbonenetwork, a regional network, etc.). The cloud or the wide area networkcan comprise wireline functional elements and/or wireless functionalelements (such as functional elements contained in a terrestrialwireless network or a satellite-based wireless network).

As employed in this specification, annexed drawings, and/or claims theterms “unit,” “component,” “engine,” “system,” “platform,”“environment,” “interface,” “repository,” “portal,” and the like areintended to include a computer-related entity or an entity related to anoperational apparatus with one or more functionalities afforded by oneor more computational resources, such as processor(s), one or morememories, network connector(s), combination thereof, and the like. Thecomputer-related entity or the entity related to the operationalapparatus can be either hardware, a combination of hardware andsoftware, software, or software in execution. One or more of suchentities also may be referred to as “functional elements.” As anexample, a unit may be, but is not limited to being, a process runningon a processor, a processor, an object, an executable computer program,a thread of execution, a program, a memory (e.g., a hard disc drive),and/or a computer. As another example, a unit can be an apparatus withspecific functionality provided by mechanical parts operated by electricor electronic circuitry which is operated by a software or a firmwareapplication executed by a processor, wherein the processor can beinternal or external to the apparatus and executes at least a part ofthe software or firmware application. As yet another example, a unit canbe an apparatus that provides specific functionality through electronicfunctional elements without mechanical parts, the electronic functionalelements can include a processor therein to execute software or firmwarethat provides at least in part the functionality of the electronicfunctional elements. An illustration of such apparatus can be controlcircuitry, such as a programmable logic controller. The foregoingexamples and related illustrations are but a few examples and are notintended to limiting or otherwise restrictive. Moreover, while suchillustrations are presented for a unit, the foregoing examples alsoapply to a component, a system, a platform, an interface and the like.It is noted that in certain embodiments, or in connection with certainaspects or features thereof, the terms “unit,” “component,” “engine,”“system,” “platform,” “environment,” “interface,” “repository,” and“portal” can be utilized interchangeably.

Throughout the present specification and drawings of the disclosure, thewords “comprise,” “include,” and “have” and variations of such words,such as “comprising” and “comprises,” “including” and “includes,”“having” and “has,” mean “including but not limited to,” and are notintended to exclude, for example, other systems, subsystems, components,action, steps, or the like. When utilized, the term “exemplary” refersto “an example of and is not intended to convey an indication of apreferred or ideal embodiment, entity, feature, or the like. “Such as”is not utilized in the present disclosure in a restrictive sense, butrather it is put forward for explanatory purposes.

Disclosed are functional elements, such as components, units, engines,interfaces, platforms, repositories, etc., that can be utilized toperform the disclosed methods and systems. These and other functionalelements are disclosed herein, and it is understood that whencombinations, subsets, interactions, groups, etc. of these componentsare disclosed that while specific reference of each various individualand collective combinations and permutation of these may not beexplicitly disclosed, each is specifically contemplated and describedherein, for all methods and systems. This applies to all aspects of thisapplication including, but not limited to, steps in disclosed methods.Thus, if there are a variety of additional steps that can be performedit is understood that each of these additional steps can be performedwith any specific embodiment or combination of embodiments of thedisclosed methods.

The methods, systems, solutions, and the like, of the disclosure maytake the form of an entirely hardware embodiment, an entirely softwareembodiment, or an embodiment combining software and hardware aspects.Furthermore, the methods and systems may take the form of a computerprogram product on a computer-readable storage medium havingcomputer-readable program instructions (e.g., computer software)embodied in the storage medium. More particularly, the present methodsand systems may take the form of web-implemented computer software. Anysuitable computer-readable storage medium may be utilized including harddisks, CD-ROMs, optical storage devices, or magnetic storage devices.

Functionality of the embodiments of is described herein with referenceto block diagrams and flowchart illustrations of methods, systems,apparatuses and computer program products. It will be understood thateach block of the block diagrams and flowchart illustrations, andcombinations of blocks in the block diagrams and flowchartillustrations, respectively, can be implemented by computer programinstructions. These computer program instructions may be loaded onto ageneral purpose computer, special purpose computer, or otherprogrammable data processing apparatus to produce a machine, such thatthe instructions which execute on the computer or other programmabledata processing apparatus create a means for implementing the functionsspecified in the flowchart block or blocks.

These computer program instructions may also be stored in acomputer-readable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner, such that the instructions stored in the computer-readablememory produce an article of manufacture including computer-readableinstructions for implementing the function specified in the flowchartblock or blocks. The computer program instructions may also be loadedonto a computer or other programmable data processing apparatus to causea series of operational steps to be performed on the computer or otherprogrammable apparatus to produce a computer-implemented process suchthat the instructions that execute on the computer or other programmableapparatus provide steps for implementing the functions specified in theflowchart block or blocks.

Accordingly, blocks of the block diagrams and flowchart illustrationssupport combinations of means for performing the specified functions,combinations of steps for performing the specified functions and programinstruction means for performing the specified functions. It will alsobe understood that each block of the block diagrams and flowchartillustrations, and combinations of blocks in the block diagrams andflowchart illustrations, can be implemented by special purposehardware-based computer systems that perform the specified functions orsteps, or combinations of special purpose hardware and computerinstructions.

FIG. 1 illustrates constumer-centric intelligent automation control inaccordance with one or more embodiments of the disclosure. As describedherein, such automation control can be implemented with respect to anenvironment, such as a dwelling, a factory or another type of industrialspace, an office or commercial space, a portion of a city or other urbanarea; or the like). Multiple events 110 associated with operation ofdevices, sensors, and/or other equipment can occur within theenvironment and/or in the vicinity thereof. For example, the multipleevents 110 can include events associated with turning on and/or offdevices, executing software, actuating sensors, or the like. In oneaspect, the multiple events 110 can be monitored or otherwise detected.In certain scenarios, the environment can be referred to as a controlledregion 104. In other scenario, the environment and at least a portion ofthe vicinity thereof can be referred to as the controlled region 104.For instance, in one such scenario, music or other sound can becontrolled within a home and an adjacent or nearby outdoor space. Asillustrated in block 120, one or more behaviors associated with thecontrolled environment can be determined based at least on the events.In one example, the one or more behaviors can include one or morepatterns of events that occur as a function of time. The one or morebehaviors can represent specific characteristics of the operation ofdevices, sensors, and/or services associated with the controlledenvironment and, as such, can permit identifying certain devices,sensors, and or services that are specific to a behavior within theenvironment. As such, as shown at block 130, hardware, firmware, and/orsoftware can be selected or otherwise identified based on the one ormore behaviors. The operation of the selected hardware, software, and/orsoftware can be controlled in order for such operation to be consistentwith a determined behavior. Therefore, as shown at block 140, one ormore controls tasks (more generally referred to as “tasks”) can beconfigured for the selected hardware, firmware, and/or software. Upon orafter configuration, at least one of the configured tasks can beimplemented. Implementation of the task(s) can be controlled by one ormore computing platforms (e.g., an orchestration platform). In addition,configuration of the tasks can be dynamic and/or responsive toconditions of one or more devices, sensors, and/or services within thecontrolled environment.

In one aspect, as illustrated in FIG. 2, the events 240 that can beutilized to determine a behavior associated with a controlledenvironment can be categorized according to the functionality of thedevice(s), sensor(s), and or service(s) associated with an event. Such acategorization can permit the configuration of tasks specific to acategory of functionality. Therefore, specific combinations ofdevice(s), sensor(s), and/or service(s) can be associated with aspecific configuration of tasks that permit operation of the controlledenvironment in accordance with an identified behavior.

In certain implementations, a configuration of tasks can be referred toas an automation control mode. In addition, such a mode can beassociated with the selected hardware, firmware, and/or software to forman automation control asset. In one aspect, such association can be alogic association and can be retained in a remote computing platform.Such a remote computing platform can utilize or otherwise leverage agroup of automation control assets to control the operation of anenvironment in accordance with one or more behaviors present in theenvironment. For example, FIG. 3 illustrates an environment 310, whichcan include devices, sensors, and/or other equipment, that can becontrolled by a group of assets 320 ₁-320 _(N). The remote computingthat can control the environment 310 can include an event engine 330that can receive and process information (e.g., data, metadata, and/orsignaling) from the environment 310 and can direct at least a portion ofthe devices, sensors, and/or equipment present in the environment 310 tooperate according to one or more of the assets 320 ₁-320 _(N). To atleast such an end, each of the assets can be configured to supplydirectives to the environment 310, where the directives can be specificto a configuration of tasks associated with the asset or can be responseto the signaling (referred to as trigger(s)) received and/or processedby the event engine 330. As illustrated the event engine 330 canexchange information with one or more devices and/or sensors within theenvironment 310 via a communication environment 314, which can includenetwork(s) (wireless or otherwise), reference links, wireless links,wireline links, combinations thereof, or the like.

As illustrated in FIG. 4, an automation control asset 410 may berepresented or otherwise characterized by one or more hardwareassociations 420 that can link respective one or more devices and/orsensors to the automation control asset 410; one or more firmwareassociations 430 that can link the respective firmware to the automationcontrol asset 410; and/or software 440, which can represent or otherwiseindicate at least specific automation sequence or logic that pertains tothe automation control asset 410. In one example, a specificconfiguration of the hardware association(s) 420, the firmwareassociation(s) 430, and the software 440 can embody or can constitute amode of the automation control asset 410. As illustrated, an automationcontrol asset, e.g., asset 410, can include one or more modes, e.g.,mode(s) 450.

FIGS. 5A, 5B, 5C, 5D, and 5E illustrate example automation controlsassets in accordance with one or more aspects of the disclosure. Theillustrated assets include “Aide,” “Trainer,” “Guardian,” “Deejay” (DJ),and “Assistant.” It should be appreciated that these automation controlassets are merely illustrative and other automation control assets arecontemplated within the disclosure. As described herein, an automationcontrol asset (e.g., “Guardian”) can operate in accordance with one ormore modes. For example, the Guardian automation control asset can havea mode, which can be referred to as “bedtime mode” which causes specificoperation of devices and/or sensor within a controlled region 710. Asdescribed herein, the controlled region can include a confinedenvironment and/or a nearby area. For example, in “bedtime mode,” theGuardian asset can lower the downstairs lights, arms the security systemand disables Wi-Fi to all of the teenagers' devices. As describedherein, in one example, the automation orchestration platform 730, or acomponent therein or functionally coupled thereto, can direct suchdevices and or sensors to operate according to the “bedtime mode.” Assuch, the automation orchestration device 730, or a component therein orfunctionally coupled thereto, can direct or otherwise communicateinstructions to the devices and/or sensors via the gateway device 712.

In one embodiment, different Guardian modes, for example, can handlesecurity services for a wide range of scenarios, which are addressed bysuch modes: Home Alone: Enhanced security for instances in whichchildren are home alone without a parent or another person responsiblefor their wellbeing (e.g., baby sitter). Doorman: Relaxed front doorsecurity for expected guests or delivery personnel. Vacation:Comprehensive security with regular push notification updates when awayfrom the home for an extended period. Around the House: Relaxed securityfor when the family is leisurely staying at home during the day.Outback: Relaxed backdoor security and increased front door security forwhen out back cooking outdoors (e.g., barbequing) or working in theyard. It should be appreciated that these automation control assets aremerely illustrative and other automation control assets are contemplatedwithin the disclosure.

As described herein, while individual automation control services can bepowerful or otherwise useful on their own, the disclosure permitsnumerous ways that such services can work collectively or otherwise incooperation via hybrid modes: Party: DJ telling Guardian that there willbe a party and to keep the back door unlocked for guests. Jog: Guardianproviding Trainer with a one-time password for the front door so youdon't need to bring keys with you on your run. Health Monitor: Trainerinforming Aide of an abnormal heart rate during the last leg of yourrun. Appointment: Aide requesting Assistant to schedule a doctor'sappointment for tomorrow afternoon. Quiet Call: Assistant asking DJ tolower the music in the room you're in when the phone rings.

Similarly, as illustrated in FIG. 6, a logical stack of automationcontrol asset(s) and mode(s) can represent an automation control servicein accordance with the present disclosure. In certain embodiments, thelogical stack can be embodied in or can include a specific configurationof control tasks and/or protocols that can permit implementation of suchtasks. The example logical stack 600 can include a stack layer 610containing one or more modes. The one or more modes can be associatedwith one or more automation control assets, which can be contained in astack layer 620. In addition, the example logical stack can include astack layer 630 containing the automation control service. As describedherein, an automation control asset and an automation control servicecan be embodied in a cloud solution—either supplied by a provider ofservices (e.g., voice, data, and/or media) to an environment that iscontrolled, or by a third-party, such as a commercial partner of theprovider. The provider of services can include a multiple systemoperator (MSO) or any other type of service provider.

FIG. 7 illustrates an example operational environment 700 forcustomer-centric intelligent control in accordance with one or moreaspects of the disclosure. The example operational environment 700includes an environment 710, such as dwelling, a business office (e.g.,a small or medium organization's office) or other commercial space, afactory or other industrial space, or the like. The environment 710 canbe controlled in accordance with at least some aspects described herein.A group of devices 714 (e.g., one or more devices) and/or a group ofsensors 716 can be deployed or otherwise installed within theenvironment 710 or in proximity thereto, or in any spatial arrangementincluding locations within the environment 710 and/or in proximitythereto. At least one of the device(s) 714 and/or at least one of thesensor(s) 716 can be functionally coupled (e.g., communicatively and/orelectrically coupled) to customer premises equipment 712, which referredto as a gateway device 712. As such, one or more of the device(s) 714can be functionally coupled to the gateway device 712 via link(s) 715,which can include upstream link(s) and/or downstream link(s). Each ofsuch link(s) can be or can include a wireless link or a wireline link.Similarly, one or more of the sensor(s) 716 can be functionally coupledto the gateway device 712 via link(s) 717, which can include upstreamlink(s) and/or downstream link(s). Each of such link(s) can be or caninclude a wireless link or a wireline link.

The gateway device 712 (which also may be referred to as gateway 712)can receive and/or transmit information from and/or to one or more of(i) at least one of the device(s) 714 or at least one of the sensor(s)716. As illustrated, the gateway 712 can be functionally coupled to anautomation orchestration platform 730 via one or more access networks720 (e.g., wireless network(s), wireline network(s), or a combinationthereof) and data and signaling pipes 725 and 727. As illustrated, thegateway 712 can be functionally coupled to at least one of thenetwork(s) 720 or a component thereof via the data and signaling pipe(s)725, and the automation orchestration platform 730 can be functionallycoupled to at least the same or another network of the access network(s)720 or a component thereof via the data and signaling pipe(s) 727. Oneor more network elements within the access network(s) 720 can permitcommunication (e.g., routing) of information between the network(s) thatcan be functionally coupled to the gateway 712 and the automationorchestration platform 730. Therefore, information (e.g., data,metadata, and/or signaling) can be received, transmitted, or exchangedbetween the automation orchestration platform 730 and the gateway 712.

In one aspect, the gateway 712 can obtain or otherwise receiveinformation from one or more of at least one of device(s) 714 or atleast one of the sensor(s) 716, and can communicate at least a portionof such information to the automation orchestration platform 730 inaccordance with aspects described herein. Various embodiments of theautomation orchestration platform are illustrated in FIGS. 10-11. Theautomation orchestration platform 730 can receive such information andcan determine behaviors of an agent associated with the environment 710.The agent can be a dweller of the confined region, whether it is a longterm dweller (e.g., an owner or tenant) or short term dweller, such as avisitor to the confined region or an employee of an organizationconducting business within the environment 710. To at least such an end,the orchestration platform 730 can determine intelligence indicative ofa behavior of the agent based at least in part on the receivedinformation. In one example, the automation orchestration platform 730can generate a model of the behavior of the agent based at least onunsupervised learning. In certain implementations, the model can beembodied in or can include one or more of a statistical Markov model, aneural network model, or a Gaussian mixture model. In addition or inother implementations, the model of the behavior of the agent can beembodied in or can include one or more of statistical Bayes model and/ora model constructed from regression analysis. In another example, theautomation orchestration platform 730 can determine a pattern of actionsof the agent and associate such a pattern to the behavior of the agent.The patter can include, for example, one or more of (i) a pattern ofsequences of events, (ii) a time-domain pattern in the at least one ofthe one or more information streams, or (iii) a space-domain pattern inthe at least one of the one or more information streams. In certainimplementations, provided a set of several patterns, the automationorchestration platform 730 can determine correlations between patternsin such a set. As described herein, such actions can be represented orotherwise indicated by the received information, which can conveyagent's activities initiated within the environment 710 or some otherenvironment, or otherwise observed (e.g., measured) within theenvironment 710 or some other environment. In certain embodiments, oneor more units (e.g., a machine learning unit) integrated into orfunctionally coupled to the automation orchestration platform 730 candetermine at least a portion of the intelligence indicative of thebehavior of the agent. In certain embodiments, regression analysisand/or Bayesian models may be used or otherwise leveraged to determinethe probability of a group of activities being related and, therefore,postulate an associated mode and/or related automation control asset. Itshould be appreciated that this disclosure is not limited with respectto regression and Bayesian models, and various other types of predictiveand causal models can be used or otherwise leveraged to determineintelligence associated with the behavior of an agent.

The automation orchestration platform 730, or a component therein orfunctionally coupled thereto, can supply an automation control assetbased at least on the intelligence associated with (e.g., indicative orotherwise representative of) the behavior of the agent described herein.In one example, the automation control asset is configured to provideautomation control of at least one of the group of devices 714. To atleast such an end, in one example, the automation orchestration platform730 can provide a recommendation to create a new automation controlasset and/or a new mode thereof in a system that combines and/or createsnew activities or control actions based on the determined behavior. Forinstance, an event engine 740 can update (e.g., combine) or generate anactivity or action associated with the automation control asset. Suchactivity or action can be part of an automated sequence related orotherwise associated with one or more of at least one of device(s) 714or at least one of the sensor(s) 716. In certain example embodiments, inorder to supply an automation control asset, the automationorchestration platform 730 can determine a configuration of tasks (e.g.,a mode) for at least one of device(s) 714 and/or at least one of thesensor(s) 716. In other example embodiments, in order to supply anautomation control asset, the automation orchestration platform 730 cangenerate a new configuration of tasks for the at least one of device(s)714, or can update an extant configuration of tasks for the at least oneof device(s) 714. In yet other example embodiments, in order to supplyan automation control asset, the automation orchestration platform 730can determine a first configuration of tasks (e.g., a first mode) for atleast one of the device(s) and/or sensor(s) based on a secondconfiguration of tasks (e.g., a second mode) associated with a secondautomation control asset.

In certain embodiments, a specific mode of an automation control assetcan be configured or otherwise arranged via a user interactivityinterface implemented at (e.g., executed by) any device that isassociated with an agent related to the environment 710. In one example,the user interactivity device can permit customizing a mode of anautomation control asset to specific needs of desired of the agent.Preference settings that configure or otherwise define a mode can permitspecific control of an environment 710 in which a group of devicesand/or a group of sensors associated with the automation control assetoperate. It should be appreciated that the user interactivity interfacebe implemented within substantially any functional element or computingdevice within the operational environment 700 or other operationalenvironments of the disclosure. In one example, the user interactivityinterface can be accessible from any connected device (e.g., a devicethat can consume a service via the gateway 712) and can permit consumersto interact with the gateway device 712, to manage their home network,manage data across devices (e.g., at least one of the device(s) 714),interact with automation control services and/or automation controlassets and related mode(s); and access one or more portals (e.g., amarketplace) within the example operational environment 700 or otheroperational environments disclosed herein. In certain embodiments, theuser interactivity interface can be implemented in response to executionof a virtual control module deployed within a network in a distributedconfiguration or within a device in a localized configuration.

As described herein, based on a specific automation control serviceand/or an automation control asset, the automation orchestrationplatform 730, or a component therein or functionally coupled thereto,can directing at least one device of the group of devices 714 and/orsensor(s) 716 to operate according to a specific mode of the automationcontrol asset and/or the automation control service. Such operation of adevice of the device(s) 714 and/or a sensor of the sensor(s) 716 alsocan be leveraged to generate additional intelligence associated with thebehavior of an agent in accordance with aspects described herein. Forinstance, correlations between agents can be leveraged or otherwiseutilized to generate at least a portion of such intelligence. As such,in one example, the intelligence associated with the behavior of anagent can be indicative or otherwise representative of a correlationbetween events associated with at least one other agent, where the atleast one other agent can be in at least one of (i) a specific controlstate of a control sequence based on the automation control service or(ii) a specific agent state.

In addition or in the alternative, the disclosure can provide orotherwise permit interactions between automation control services and/orautomation control assets associated therewith. Such interactionsprovide a rich gamut of tasks and/or operations than can rendercustomer-centric the automation of an environment. Such tasks and/oroperations can be dynamically adjusted based on intelligence refinementor otherwise development of an extant service based at least on (1)information collected in response to implementation of an automationcontrol service, and/or (2) collection, identification, and/or analysisof information indicative or otherwise representative of events that mayoccur at a device within or in proximity to a controlled environment;during execution of an application in a computing device; duringimplementation of a control sequence; and/or due to activity of an agent(human or otherwise) within or in proximity of a controlled environment(e.g., environment 710).

As described herein, the gateway device 712 can exchange information(data, metada, and/or signaling) with the automation orchestrationplatform and/or other platform(s) integrated therein or associatedtherewith. In one aspect, the gateway device 712 can recognize at leastone of the device(s) 714 and/or at least one of the sensor(s) 716, andcan leverage connectivity standards (e.g., radio communication protocolsand/or other communication protocols, packetized or otherwise) in orderto provide managed automation control services and/or assets availablevia one or more network platforms, such as an automation solutionplatform(s) 790, which can include one or more automation controlsolution(s) 792, and/or a third-party solution platform(s) 780. FIG. 8Aillustrates an example of an operation environment 800 including thethird-party solution platform(s) 780 and the automation solutionplatform(s) 790. As described herein, the automation control solution(s)792 can include a group of automation control assets, such as thosedescribed herein in connection herein with FIGS. 5A-5E, each of whichbeing configured or otherwise operable to provide customer-centricintelligent control in accordance with one or more aspects of thisdisclosure. In addition, in certain embodiments, the third-partysolution platform(s) 780 can provide various services that cansupplement or complement an automation control asset. As illustrated,the third-party solution platform(s) 780 can include a media serviceplatform 812 that can provide music, images, videos, combinationsthereof, or any type of media consumable in user equipment or CPE. Suchmedia can include customer-specific and/or asset-specific content thatcan be provided to the environment 710 in response to implementation ofan automation control asset. The media service platform 812 can includean over-the-top (OTT) media platform and/or other types of mediaplatforms. In addition, the third-party solution platform(s) 780 caninclude a security platform 816 that can provide security service(s) toa device or other type of equipment within the environment 710. Further,the third-party solution platform(s) 780 can include a social mediaplatform 818 that can provide information feeds (e.g., blog feeds,microblog feeds, news aggregation services, posts on social mediaoutlets, etc.) to a device or other type of equipment within theenvironment 710. Further, a group of open API(s) 820 can permitaccessing functionality associated with an automation control asset viathe development platform 770. More specifically, in certainimplementations, the open API(s) 820 can permit developing such anautomation control asset, including configuring asset modules, creatingrelationships to hardware, and/or creating associations to firmware.

As illustrated, the exemplified operational environment 800 alsoincludes the automation solution platform(s) 790, which can beadministered or otherwise provided by the entity (e.g., a serviceprovide or MSO) that provides the automation orchestration platform 730.In addition to including the automation control solution(s) 792, theautomation solution platform(s) 790 also include a group of open API(s)822. At least one of the group of open API(s) 820 can permit accessingfunctionality for an automation control asset, including configuringasset modules, creating relationships to hardware, and/or creatingassociations to firmware.

FIGS. 12-13 illustrate example embodiments of computing devices that canembody or can constitute the gateway device 712 in accordance withaspects of the disclosure. As illustrated, the computing device 1310 caninclude a radio unit 1312 that can permit wireless communication betweenthe computing device 1310 and other device(s) of the device(s) 714and/or sensor(s) 716. FIG. 14 illustrates an example embodiment 1400 ofthe radio unit 1312 in accordance with one or more aspects of thedisclosure. As illustrated, the radio unit 1312 can include one or moreantennas 1316 and a multi-mode communication processing unit 1318. Incertain embodiments, the antenna(s) 1316 can be embodied in or caninclude directional or omnidirectional antennas, including, for example,dipole antennas, monopole antennas, patch antennas, loop antennas,microstrip antennas or other types of antennas suitable for transmissionof RF signals. In addition, or in other embodiments, at least some ofthe antenna(s) 1316 can be physically separated to leverage spatialdiversity and related different channel characteristics associated withsuch diversity. In addition or in other embodiments, the multi-modecommunication processing unit 1318 that can process at least wirelesssignals in accordance with one or more radio technology protocols and/ormodes (such as MIMO, single-input-multiple-output (SIMO),multiple-input-single-output (MISO), and the like. Each of suchprotocol(s) can be configured to communicate (e.g., transmit, receive,or exchange) data, metadata, and/or signaling over a specific airinterface. The one or more radio technology protocols can include 3GPPUMTS; LTE; LTE-A; Wi-Fi protocols, such as those of the Institute ofElectrical and Electronics Engineers (IEEE) 802.11 family of standards;Worldwide Interoperability for Microwave Access (WiMAX); radiotechnologies and related protocols for ad hoc networks, such asBluetooth or ZigBee; other protocols for packetized wirelesscommunication; or the like). The multi-mode communication processingunit 1318 also can process non-wireless signals (analogic, digital, acombination thereof, or the like).

In one embodiment, e.g., example embodiment 1400 shown in FIG. 14, themulti-mode communication processing unit 1318 can comprise a set of oneor more transmitters/receivers 1404, and components therein (amplifiers,filters, analog-to-digital (A/D) converters, etc.), functionally coupledto a multiplexer/demultiplexer (mux/demux) unit 1408, amodulator/demodulator (mod/demod) unit 1416 (also referred to as modem1416), and a coder/decoder unit 1412 (also referred to as codec 1412).Each of the transmitter(s)/receiver(s) can form respectivetransceiver(s) that can transmit and receive wireless signal (e.g.,electromagnetic radiation) via the one or more antennas 1316. It shouldbe appreciated that in other embodiments, the communication processingunit 1318 can include other functional elements, such as one or moresensors, a sensor hub, an offload engine or unit, a combination thereof,or the like. In one aspect, such a unit can be configured by programmedinstructions retained in the memory 1330 and/or other memory devicesintegrated into or functionally coupled to the unit.

Electronic components and associated circuitry, such as mux/demux unit908, codec 1412, and modem 1416 can permit or facilitate processing andmanipulation, e.g., coding/decoding, deciphering, and/ormodulation/demodulation, of signal(s) received by the computing device1310 and signal(s) to be transmitted by the computing device 1310. Inone aspect, as described herein, received and transmitted wirelesssignals can be modulated and/or coded, or otherwise processed, inaccordance with one or more radio technology protocols. Such radiotechnology protocol(s) can include 3GPP UMTS; 3GPP LTE; LTE-A; Wi-Fiprotocols, such as IEEE 802.11 family of standards (IEEE 802.ac, IEEE802.ax, and the like); WiMAX; radio technologies and related protocolsfor ad hoc networks, such as Bluetooth or ZigBee; other protocols forpacketized wireless communication; or the like.

The electronic components in the described communication unit, includingthe one or more transmitters/receivers 1404, can exchange information(e.g., data, metadata, code instructions, signaling and related payloaddata, combinations thereof, or the like) through a bus 1414, which canembody or can comprise at least one of a system bus, an address bus, adata bus, a message bus, a reference link or interface, a combinationthereof, or the like. Each of the one or more receivers/transmitters1404 can convert signal from analog to digital and vice versa. Inaddition or in the alternative, the receiver(s)/transmitter(s) 1404 candivide a single data stream into multiple parallel data streams, orperform the reciprocal operation. Such operations may be conducted aspart of various multiplexing schemes. As illustrated, the mux/demux unit1408 is functionally coupled to the one or more receivers/transmitters1404 and can permit processing of signals in time and frequency domain.In one aspect, the mux/demux unit 1408 can multiplex and demultiplexinformation (e.g., data, metadata, and/or signaling) according tovarious multiplexing schemes such as time division multiplexing (TDM),frequency division multiplexing (FDM), orthogonal frequency divisionmultiplexing (OFDM), code division multiplexing (CDM), space divisionmultiplexing (SDM). In addition or in the alternative, in anotheraspect, the mux/demux unit 908 can scramble and spread information(e.g., codes) according to most any code, such as Hadamard-Walsh codes,Baker codes, Kasami codes, polyphase codes, and the like. The modem 1416can modulate and demodulate information (e.g., data, metadata,signaling, or a combination thereof) according to various modulationtechniques, such as frequency modulation (e.g., frequency-shift keying),amplitude modulation (e.g., M-ary quadrature amplitude modulation (QAM),with M a positive integer; amplitude-shift keying (ASK)), phase-shiftkeying (PSK), and the like). In addition, processor(s) that can beincluded in the computing device 1310 (e.g., processor(s) included inthe radio unit 814 or other functional element(s) of the computingdevice 1310) can permit processing data (e.g., symbols, bits, or chips)for multiplexing/demultiplexing, modulation/demodulation (such asimplementing direct and inverse fast Fourier transforms) selection ofmodulation rates, selection of data packet formats, inter-packet times,and the like.

The codec 1412 can operate on information (e.g., data, metadata,signaling, or a combination thereof) in accordance with one or morecoding/decoding schemes suitable for communication, at least in part,through the one or more transceivers formed from respectivetransmitter(s)/receiver(s) 1404. In one aspect, such coding/decodingschemes, or related procedure(s), can be retained as a group of one ormore computer-accessible instructions (computer-readable instructions,computer-executable instructions, or a combination thereof) in one ormore memory devices 1330 (referred to as memory 1330). In a scenario inwhich wireless communication among the computing device 1310 and anothercomputing device (e.g., a station or other types of user equipment)utilizes MIMO, MISO, SIMO, or SISO operation, the codec 1412 canimplement at least one of space-time block coding (STBC) and associateddecoding, or space-frequency block (SFBC) coding and associateddecoding. In addition or in the alternative, the codec 1412 can extractinformation from data streams coded in accordance with spatialmultiplexing scheme. In one aspect, to decode received information(e.g., data, metadata, signaling, or a combination thereof), the codec1412 can implement at least one of computation of log-likelihood ratios(LLR) associated with constellation realization for a specificdemodulation; maximal ratio combining (MRC) filtering,maximum-likelihood (ML) detection, successive interference cancellation(SIC) detection, zero forcing (ZF) and minimum mean square errorestimation (MMSE) detection, or the like. The codec 1412 can utilize, atleast in part, mux/demux unit 1408 and mod/demod unit 1416 to operate inaccordance with aspects described herein.

With further reference to FIG. 13, the computing device 1310 can operatein a variety of wireless environments having wireless signals conveyedin different electromagnetic radiation (EM) frequency bands. To at leastsuch end, the communication processing unit 1318 in accordance withaspects of the disclosure can process (code, decode, format, etc.)wireless signals within a set of one or more EM frequency bands (alsoreferred to as frequency bands) comprising one or more of radiofrequency (RF) portions of the EM spectrum, microwave portion(s) of theEM spectrum, or infrared (IR) portion(s) of the EM spectrum. In oneaspect, the set of one or more frequency bands can include at least oneof (i) all or most licensed EM frequency bands, (such as the industrial,scientific, and medical (ISM) bands, including the 2.4 GHz band or the 5GHz bands); or (ii) all or most unlicensed frequency bands (such as the60 GHz band) currently available for telecommunication.

In addition, the computing device 1310, which can embody or canconstitute the gateway device 712, can include one or more I/Ointerface(s) 1322 that can permit wireline communication between thecomputing device 1310 and other devices (e.g., a network device and/or adevice of the device(s) 714, or at least one of the sensor(s) 716). Theradio unit 1312 can permit wireless communication according to variousradio technology protocols, such as Wi-Fi, LTE, LTE-A, BlueTooth,Zigbee, and the like (see, e.g., FIG. 12 for an illustration of variousprotocols contemplated in this disclosure).

Specific application functionality of the gateway device 712, asembodied in the computing device 1310 can be permitted, at least inpart, via one or more management unit(s) 1326 and/or managementinformation that can be retained in one or more memory elements referredto as management info. 1340. In general, the “application” functions inthe gateway device 712 can be configured or otherwise provided to beflexible in terms of execution environment. In one example, suchfunctionality can be implemented within SDN and/or NFV, where the higherlayer capabilities can be shifted out of the computing device 1310(e.g., a set-top box, CPE, or other premises device) into serviceprovider's data center/cloud, such as the automation solutionplatform(s) 790. Accordingly, in certain embodiments, the gateway device712, as embodied in the computing device 1310, for example, can beembodied in a virtual function that can include the I/O interface(s)1322 (e.g., physical interfaces) and the radio unit 1312 into theenvironment 710, and that can provide processing capabilities based on aremotely located platform, which can render such capability locationagnostic. In addition, the gateway device 712, as embodied in thecomputing device 1310, for example, can be seen as a physical layerconnector and/or a an information (e.g., data and/or metadata)collector. Yet, intelligence and/or processing functionality to anythingat the application layer and/or applying logic could be local and/orremote.

In one aspect, the gateway device 712, as embodied in the computingdevice 1310, for example, can provide a substantive breadth ofautomation control services and other services via the gateway device712 and/or regulated by the same (such as, any Internet app, POTS/VoIP,managed video, home security, etc.). As such, the gateway device 712, asembodied in the computing device 1310, for example, can include one ormore management unit(s) that can permit applying one or more of rules,filters, and/or policies (which can be embodied or otherwise retained inthe management information 1340) that can be applied could be to anyindividual or combination of services, either automation controlservices or otherwise.

In certain embodiments, the gateway device 712, as embodied in thecomputing device 1310, for example, can provide one or more intelligencecomponent(s) which can be focused on a network management layer. Forexample, such intelligence can manages bandwidth, QoS, and relatedservice delivery aspects in response to adaptation of an automationcontrol service to specific events (e.g., changes of environmentalcondition, behaviors, interests, and the like) within the environment710. In one example, such intelligence can be tied to proactive controlsbeing set by consumer, parts may be tied to modes, and parts may be setto passive management and/or optimization, e.g., autonomous adjustmentof automation control mode(s) associated with an automation controlservice. Accordingly, a consumer can customize the delivery of a servicewithin the environment 710 via network management (e.g., functionalityassociated with cloud solutions and/or automation control serviceswithin a networked automation solution platform. For instance, aconsumer can go into “work at home” mode, which can be part of the“Assistant” asset, and bandwidth automatically optimized for the homecomputer at the environment 710 (e.g., a residential dwelling), virtualprivate network (VPN) can be established, while other connecteddevice(s) within the environment 710 (e.g., a child's tablet can besub-optimized for streaming media). Important to note that security isanother aspect and not just QoS. So, for services which requireadditional data security (e.g. home health) there would be the necessaryprotections from a network security standpoint.

As described herein, the operational environment 100 and otheroperational environments described herein can provide a system forcustomer-centric intelligent control of an environment in accordancewith aspects described herein. In certain embodiments, the examplesystem can include the automation orchestration platform 130, thegateway device 112, which can be functionally coupled to the automationorchestration platform 130 via an access network; and a plurality ofdevices (e.g., device(s) 114 and/or sensor(s) 116) functionally coupledto the gateway device 112. As described herein, the plurality of devicesincludes at least one of customer premises equipment, a transducer, asensor, a medical device, a three-dimensional printer, a detector, ascanner, a code-reader device, an radio-frequency identification (RFID)reader, a controller, a telecommunication receiver, a telecommunicationtransmitter, a telecommunication transceiver, a tethered computingdevice, a wireless computing device, a wearable device, or an appliance.In one embodiment, the example system can include a service platform,e.g., one or more automation solution platforms 190 comprising one ormore automation control solutions 192, which can include one or moreautomation control assets/services comprising at least device and/or anautomation control module (e.g., software 540). It should be appreciatedthat these controls can either be passive, e.g., based on informationrelated to operation of device(s) and/or sensor(s) can learn andautonomously adjust, or can be configured manually, via activating amode associated with the automation control asset, for example. Asillustrated in at least some of the operational environments of thedisclosure, such a service platform may be implemented in one or morethird-party solution platforms 780 (see, e.g., FIG. 8A).

In addition, the example system for customer-centric intelligentautomation control provided herein can include a development platform770 (and/or a modes development center as shown in FIGS. 7 and 8A, forexample) that can permit generating or updating an automation controlmodule/asset. In one aspect, the development control platform caninclude a group of one or more interfaces, such as applicationprogramming interfaces (APIs), that can permit access to and/orconfiguration of at least one of the device(s) 714 and/or sensor(s) 716,for example, in order to configure a specific automation controlservice, automation control asset, and/or mode. In the exampleoperational environment 700, such interface(s) (e.g., APIs) can beaccessed by one or more developers devices 774 (which also may bereferred to as developer(s) 774). At least one of the developer(s) 774can be functionally coupled to the development platform 770 (or themodes development center in the operational environment of FIG. 12, forexample)

In addition, the example system for customer-centric intelligentautomation control provided herein can include an event managementplatform 740 (generally referred to as an event engine 740) that may beconfigured to monitor operational activity of at least one device of aplurality of devices and/or at least one sensor of a plurality ofsensors. The event engine 740 can have the same or substantially thesame functionality of the event engine 330. FIG. 8B illustrates anexample embodiment 830 of the event engine 740. As illustrated, theevent engine 740 can include a device event engine 834 that can receivesignaling or other type of information (e.g., data and/or metadata)associated with operation of a device—e.g., execution of a command,detection of a stimulus (e.g., change in temperature, change in lightingconditions, and the like. Such a device can have a relationship with aspecific automation control asset, or can be included within theenvironment 710 without an established relationship with the automationcontrol asset. As an illustration, such a device can be embodied in orcan include a medical device that can provide data and/or metadata whilethe automation control asset that does not have a relationship with themedical device is being executed. The event engine 740 also can includea control sequence event engine 836 that can implement a specificcontrol sequence (e.g., a sequence of tasks) of an automation controlasset. The control sequence event engine 836 also can monitor orotherwise detect events associated the automation control asset. Theevent engine 740 also can include other engines that can permitimplementing and/or monitoring events associated with environment 710.More specifically, the event engine 740 can include an environmentalevent engine 840 that can, for example, monitor or otherwise detectevents that can provide context of the environment 710. The context caninclude information indicative or representative of conditions relatedto the environments. Such information can be indicative or otherwiserepresentative of one or more of (i) weather conditions in the vicinityof the environment 710, (ii) safety alerts (e.g., Amber alerts, schoollockdowns, inmate escapes, vehicular accidents, etc.) in the vicinity ofthe environment 710, (iii) traffic conditions in the vicinity of theenvironment 710, (iv) travel alerts associated with an itinerary of anagent associated with the environment 710, or the like. In addition orin other embodiments, the event engine 740 can include a third-partyapplication event engine 838 that can monitor or otherwise collectinformation associated with execution of a specific third-partyapplication that can linked or otherwise associated with an automationcontrol asset. As an example, the third-party application event engine838 can collect data and/or metadata generated by a running application(e.g., RunKeeper, endomondo, or the like) executed on a mobile deviceassociated with an automation control asset (e.g., the Trainer assetdescribed herein). As another example, the third-party application eventengine 838 can collect data and/or metadata generated by a gamingapplication executed on a gaming console included in the device(s) 714or in the cloud, where the gaming console can be associated with anentertainment and/or fitness automation control asset.

With further reference to FIG. 8B, the event engine 740 can include anactivity event engine that can monitor utilization of a specificautomation control asset or an agent thereof (e.g., a device associatedwith the asset, a software module associated with the asset, firmwareassociated with the asset, or the like). The activity event engine 842can generate utilization records (or logs) that, in certainimplementations, can be aggregated or otherwise analyzed, prior toretaining at least a portion of such records in the repository 760.

The example system for customer-centric intelligent automation controlprovided herein also can include a credential management platform 750(referred to as a credential manager 750) that can permit validationand/or authorization to utilization of automation control servicesand/or related automation control assets. In certain embodiments, suchas example embodiment 850 shown in FIG. 8C, the credential manager 750can include an access unit 854 that can control or otherwise manageaccess (e.g., manage validation and/or authorization) to an automationcontrol solution provided by the third-party solution platform(s) 780 orthe automation solution platform(s) 790. As illustrated, the credentialmanager 750 can include a brokerage unit 858 that can permit theexchange of credentials (e.g., private keys, public keys, or the like)or other information that can permit access to an automation controlsolution available at the third-party solution platform(s) 780 or otherthird-party source. The credential manager 750 also can include anactivity unit 856 that can monitor the access to an automation controlsolution by an agent thereof (e.g., hardware, firmware, software, and/orsoftware in execution associated with the solution) or an agentassociated with an environment controlled by such the automation controlsolution. More specifically, for example, the activity unit 856 cangenerate records of access to the automation control solution. As such,the activity unit 856 can generate historical information (e.g., dataand/or metadata) indicative or otherwise representative of usage orother types of metrics representative of the desirability of theautomation control solution. Further, the credential manager 750 caninclude one or more memory devices 860 (referred to as key storage 860)that can include credentials or other types of information that canpermit validation and authorization to access an automation controlsolution and/or other type of services. In one example, such credentialsor other types of information can include private keys, public keys,tokens (e.g., data structures indicative of scope of permitted access,such as type of service to be access, period available for access,etc.), and the like.

FIG. 9 illustrates an example embodiment 900 of a business developmentplatform 904 in accordance with one or more embodiments of thedisclosure. As illustrated, the business development platform 904 caninclude various systems that can permit administering certain aspects ofdeployment and/or for management of an automation control service inaccordance with aspects of this disclosure. In one aspect, the businessdevelopment platform 904 can permit commercializing automation controlservices. More specifically, the business development platform 904 caninclude a sales system 910 and a marketing system 920. In oneembodiment, that permits introducing an end-user or another type ofconsumer to an automation control solution and selling such a solutionto the consumer. In addition or in another embodiment, the sales system910 can permit transactions between an end-user or other type ofconsumers and an entity that provides automation control services (suchas a MSO). Such transactions can be directed to a sale of an automationcontrol service and/or an automation control asset, and thus, thetransactions can include various ecommerce flows or other type of salelogic and associated information. Therefore, in one example, the salessystem 910 can permit or otherwise facilitate exchange of informationbetween a remote computing device of a consumer engaged in the purchaseof an automation control service and/or an automation control asset.Similarly, the sales system 910 also can permit or otherwise facilitatethe exchange of information between a remote device of a third-partyprovider of components (e.g., devices, software libraries, or the like)associated with an automation control service and/or an automationcontrol asset. In one embodiment, the sales system 910 can processpayment for an automation control service and/or an automation controlasset. Similarly, the business development platform 904 can include amarketing system 920 that can permit advertising or otherwise promotingautomation control solutions in accordance with aspects of thedisclosure. The marketing system 920 can include or can be functionallycoupled to a sub-system for generation of advertisement and/or to mediaoutlets for dissemination or publication of the advertisement. The mediaoutlets can include printed media and/or digital media (e.g., web-basedmedia, social media, a combination thereof, or the like).

In addition, the business development platform 904 can include afulfillment system 930 that can permit generating a new account for anautomation control solution of this disclosure, and provisioning such asolution. Further, a customer care system 940 of the businessdevelopment platform 904 can permit receiving queries regarding issueswith service and/or expansion of the service (e.g., purchase andprovisioning of additional automation control assets). The businessdevelopment platform 904 also can include a field force system 950 thatcan permit coordinating and/or supplying field technician forinstallation of a gateway, devices, sensors, or other equipmentassociated with an automation control solution of the disclosure. Asdescribed herein, third-party solutions and/or applications can beincludes within the customer-centric intelligent automation of thisdisclosure. As such, in the illustrated embodiment, the businessdevelopment platform 904 can include a partner management system 960that can permit maintaining a business relationship with a commercialpartner that provides at least some of the automation control assets ofthis disclosure. The business development platform 904 also can includeone or more operation system(s) 970 that can implement provisioning,entitlement management, billing, and/or other operational aspects. Incertain implementations, at least a portion of the business developmentplatform 904 can be embodied in or can constitute an a BSS/OSS platform.

In certain embodiments, the automation orchestration platform 730 cancomprise an asset portal (or asset portal platform, which can include aservice and/or mode marketplace) comprising one or more interfaces, suchas the portal interface(s) 1010 shown in FIG. 10, configured to exposeand/or provide access to one or more of a catalog of automation controlmodules/assets or a promotion. In one example, the asset portal cancomprise one or more interfaces (e.g., APIs) configured to providecatalog management. In another example, the asset portal can compriseone or more interfaces (e.g., the portal interface(s) 1010) configuredto provide access to a third-party agent/entity, such as a computingdevice of a business partner of a service provider that administers theautomation orchestration platform 730.

In certain embodiments, the asset portal (which can embody or canconstitute a service and/or mode marketplace, as shown in FIG. 12, forexample) can include one or more interfaces configured to permit atransaction associated with the automation control asset, wherein thetransaction comprises one or more of a purchase of the automationcontrol asset, a review of the automation control asset, or apublication (or post) of the automation control asset.

In certain embodiments, the automation orchestration platform 730 caninclude a user management platform, e.g., at least one of managementinterface(s) 1020, that can permit access to and/or configuration of useprofile(s) associated with a controlled environment 710, as well assingle-sign-on functionality directed to one or more applicationsutilized or leveraged within or in proximity of a controlledenvironment, such as environment 710. In addition, the user managementplatform also can provide billing features associated with a user devicethat consumes an automation control service in accordance with thedisclosure.

In addition or in the alternative, automation orchestration platform 730or other automation orchestration platforms of the disclosure can ainclude device management platform, e.g., at least one of the managementinterface(s) 1020, that can permit provisioning, monitoring, anddata-harvesting associated with operation of at least one the device(s)714 and/or at least one of the sensor(s) 716. Information so collectedby the device management platform can be retained in the repository 1040or other memory device(s), and can be utilized or otherwise leveragedfor generation of automation control services, automation controlassets, and/or a service mode.

In certain embodiments, as illustrated in the example embodiment 1100shown in FIG. 11, the portal interface(s) 1010, the managementinterface(s) 1020, the server(s) 1030, and the repository 1040 can bearranged in layers. A layer can include physically distributedfunctional elements and can operate as a single logical unit. In theillustrated embodiment, the orchestration platform can include anexchange layer 1120 that can receive multiple streams of information(represented with arrows) from a controlled environment (e.g.,environment 710). The automation orchestration platform 710 also caninclude a mediation layer 1130 and an analysis layer 1140, each of whichcan analyze or otherwise process at least a portion of the informationreceived at the automation orchestration platform. In addition, theautomation orchestration platform 730 also can include an assetgeneration layer 1150 can provide (e.g., compose or otherwise generate)an automation control asset in accordance with aspects of thisdisclosure. As illustrated, the automation orchestration platform 730can include a storage layer 1160 that can retain information receivedand/or generated at the automation orchestration platform 730. Busarchitecture 1164 can permit the exchange of information between two ormore of the layers that constitute the automation orchestration platform730. As described herein, the automation orchestration platform 730 canbe functionally coupled (e.g., communicatively coupled to the eventengine 740.

FIG. 15 illustrates an example operational environment 1500 fordevelopment of automation control services in accordance with one ormore embodiments of the present disclosure. The operational environment1500 can be distributed, which can permit development of an automationcontrol service by a developer associated with an entity the canadministers the service or a third-party developer. As illustrated, adeveloper device 1510 can include one or more configuration modules 1514that can communicate with an asset marketplace platform 1526 via acommunication environment 1520. As illustrated, the asset marketplaceplatform 1526 is functionally coupled to an API exposure layer 1530 viacommunication links 1528. It should be appreciated that in certainembodiments, the API exposure layer 1530 can be integrated into theasset marketplace platform 1526. Communication links 1524 can permitdownstream and upstream communication of information (e.g., data,metadata, and/or signaling) between the developer device 1510 and thecommunication environment 1520. Similarly, communication links 1528 canpermit upstream and downstream communication of information between theAPI exposure layer 1530 and the communication environment 1520. As such,the communication links 1524 and 1528, and the communication environment1520 can permit exchange of information between at least one of theconfiguration module(s) 1514 and the API exposure layer 1530 or acomponent thereof. In one embodiment, the API exposure layer 1530 caninclude one or more servers (which may be referred to as API servers)that can provide APIs for configuration of an automation controlservice. To at least such an end, in one example, at least one of theconfiguration module(s) 1514 can cause the developer device 1510 torender a user interface (UI) that can permit selection of frameworks forconfiguration of the automation control service. The frameworks caninclude a service framework having a premises framework associated witha confined region to be automated, and an activity framework associatedwith the certain functionality to be automated.

As an illustration, FIG. 16 presents an example of a UI 1600 that canpermit configuration of the automation control service in accordancewith one or more embodiments of the disclosure. The example UI 1600 caninclude indicia 1610 representing a single-family dwelling to becontrolled. It should be appreciated that the disclosure is no solimited and, in other embodiments, the UI 1600 can include indiciarepresentative of other types of dwelling or environment to becontrolled—e.g., MDU, an industrial space, a commercial space, or thelike. The indicia 1610 can include selectable or otherwise actionableportions that, in response to actuation, can cause the developer device1610 to present indicia 1620 representative of a floor plan of thesingle-unit dwelling. To that end, in certain embodiments, the assetmarketplace platform 1626 access (e.g., retrieve and/or receive)information indicative or otherwise representative of the single-familyunit, and can send such information and/or second information (e.g.,metadata) to the developer device 160 to present the indicia 1620. Morespecifically, yet not exclusively, one of the configuration module(s)1614 can render or otherwise process the received information and cancause a display unit or other suitable input/output (I/O) interface ofthe developer device 1610 to present the processed information.

In addition, the indicia 1630 also can include selectable or otherwiseactionable indicia 1632, 1634, 1636, and 1638 that can identify certainregions of the floor plan. Selection of each of the indicia 1632, 1634,1636, 1638 can cause the developer device 1610 to present serviceelements (e.g., device(s) and/or sensor(s)) associated with therespective region selected in the floor plan of the single-familydwelling. In the illustrated embodiment, service elements 1645 a, 1645b, and 1645 c can be presented in response to selection of theactionable indicia 1638. In addition or in other embodiments, theexample UI 1600 can include indicia 1640 representative of activityframeworks for functionalities that can be automated in a specificregion of a floor plan of the single-family dwelling. Thefunctionalities can include music or other types of sound; motion;climate control (e.g., temperature regulation, humidity regulation);energy consumption control; lighting; security, including physicalsecurity and/or digital security; parental controls; a combination ofthe foregoing; or the like. In certain implementations, selection of anactivity framework can cause the developer device 1510 to present someof all of the devices and/or sensors associated with the activityframework. In the example UI 1600, window locks 1647 a-1647 g can bepresented in response to selection to a security framework of theactivity frameworks 1640. In addition or in other implementations,presentation of the window locks 1647 a-1647 g can be accompanied ofpresentation (e.g., display) of a sensor framework that can permitconfiguration, via input information, for example, of the type of lock,activity (e.g., locked/unlocked cycles) associated with the lock, and/orlocation of the lock. For other type of sensors and/or devices, thesensor framework also can permit configuration of sensitivity range of asensor or a device, and/or operational range of the sensor or device. Itshould be appreciated that the developer device 1510 can present UIssimilar to UI 1600 for other service frameworks associated with otherpremises, such as a multiple-dwelling unit (MDU) framework, a factoryframework, a hospital framework; a small or medium business (SMB)framework, such as an office framework, a retail store framework, amedical office framework; and the like.

The asset marketplace platform 1526 can permit configuration of anautomation control service in response to selection of a premisesframework and/or an activity framework as described herein. In addition,in certain embodiments, in response to configuration of the automationcontrol service, the API exposure layer 1530 can provide or otherwiseexpose the automation control service and/or an automation control assetas a service in order to be re-used. More specifically, yet notexclusively, the selection of the premises framework and/or the activityframework can cause at least one of the configuration module(s) 1514 tospecify the automation control service using a common control languageand/or a common information model, which can be represented by apredetermined service schema. In one aspect, the predetermined serviceschema can describe or otherwise specify the automation control servicein an automatically parsable manner. In certain embodiments, the serviceschema can be embodied in or can include an extensive markup language(XML) schema that can described actions and/or elements associated withthe automation control service. In other embodiments, the service schemacan be embodied in or can include a unified modeling language (UML)representation. As an illustration, FIGS. 17A-17B present an example UMLschema for an example embodiment in which the Trainer and the DJ assetscan operate concurrently. An illustration can include a treadmillconfigured by the Trainer asset for some specific workout (e.g., ahill-workout) with the DJ asset playing suitable music to help the userkeep a certain pace. Although not shown, in certain embodiments, an HVACasset also can be configured to operate concurrently with Trainer and DJassets (see, e.g., FIGS. 5B and 5D) in order to include temperaturecontrol, which can regulate the temperature of an environment in whichtreadmill is operated so as to ensure that the user does not overheat.Further, as illustrated, features of the Aide asset (see, e.g., FIG. 5A)can be incorporated in order to include information (e.g., data and/ormetadata) related to biometrics of the user while the workout is inprogress. Off-page connectors “A,” “B,” “C,” “D,” and “E” in diagrams1700 and 1750 are utilized for the sake of clarity, simplifying thepresentation of the full example UML schema. Labels “17A and “17B”refer, respectively, to FIGS. 17A and 17B.

Regardless the specific formal representation of the service schema, anautomation control service can be configured by specifying statevariables, actions, elements, events, and/or schedules. The configuredautomation control service also can have an attribute indicative orotherwise representative of a monetary quantity associated with theusage of the automation control service by a consumer. A secondattribute indicative or otherwise representative of a second monetaryquantity associated with re-use by a developer (e.g., via the developerdevice 1510, for example) also can be included in the representation orspecification provided by the service schema. In addition, theconfigured automation control service can include a reference to afunctionality provided by another automation control service and/or anautomation control asset thereof. Specification of such variable(s) canbe implemented according to the common information model. For anautomation control asset, the common information model can include assetinformation that can characterize a service element associated with anautomation control service. The asset information can include one ormore of the following types of information: asset type (e.g., doorsensor, entry lock, thermostat, audio device, or the like); stateinformation (e.g., on/off, open/closed, current temperature, currenthumidity, volume level, or the like); controllable capabilities oractions (e.g., power state, temperature set point, volume set point);event attributes; event thresholds (e.g., changes in temperature,changes in humidity, changes in heartbeat rate); or the like. Inaddition, a representation of an asset can be provided, wherein theasset can be embodied in or can include physical devices or sensors(such as temperature sensors, door contact sensor, biometric sensors,audio system) or logical software entities (such as an applicationrunning on a common computing platform (e.g. a personal computer, asmartphone, a tablet computer, a video set-top box (STB), a homesecurity panel, a home data router platform, or the like). Therepresentation of the asset can be agnostic to the specificimplementation of an automation control service including the asset.

In addition or in other embodiments, the common control language of thisdisclosure can permit the discovery, control, and/or orchestration ofevents and/or actions across automation control assets based at least ona specific common information model. In one embodiment, the API exposurelayer 1530 can expose the common control language as one or moreapplication programming interfaces (APIs). At least one of such APIs canprovide, for example, methods to (i) retrieve the inventory of events ina premises or location (e.g., getDevices[accountID, device array]); (ii)subscribe to events from a given asset (e.g., setEvent[accountID,assetID, eventID]); (iii) set an attribute of an asset (e.g.,setAssetAttribute[accountID, assetID, attribute]); (iv) set an attributeor receive events based on specific people; and the like.

The common control language can be embodied in or can include, forexample, programmatic language that can include one or more APIs and thecommon information model described herein for developing automationcontrol assets (e.g., software applications and/or firmware) that can beexecuted in a common application and device environment (e.g. on anin-premises control panel or automation hub). The programmatic languagecan include, for example, high level scripting (such as Java Script,Phython, or the like), lower level programming languages (e.g., C#, C,Java), and/or programming approaches (e.g., assembler, ladder logic, orthe like).

In certain embodiments, configuration of an automation control serviceby the developer device 1510 can cause the asset marketplace platform1526 to supply information indicative of the automation control serviceand/or the functionality thereof to a service inventory 1550. To thatend, in one example, the asset marketplace platform 1526 can utilize orotherwise leverage the API exposure layer 1530. Similarly, the assetmarketplace platform 1526 can supply information indicative of one ormore service elements (e.g., hardware, firmware, or software) and/or thefunctionality thereof to one or more memory elements 1560. As such, inone aspect, the automation control service and/or elements thereof canbe inventoried in response to configuration of such a service.

In addition or in certain embodiments, configuration of an automationcontrol service by the developer device 1510 can cause the assetmarketplace platform 1526 to provide a recommendation for specificautomation functionality, a specific automation control service, or anelement thereof. To that end, in one example, the asset marketplaceplatform 1526 can utilize or otherwise leverage a recommendation engine1570, which can be accessed via the API exposure layer 1530. Morespecifically, yet not exclusively, the recommendation engine 1570 cangenerate such a recommendation. The recommendation can be directed toexpanding the usefulness of the configured automation control serviceand can be based, for example, at least on usage information indicativeof operation of devices, sensors, and/or behavior of an agent associatedwith a confined region that is automated. In addition or in thealternative, the recommendation can be directed toward informing adeveloper of another automation control that the configured automationcontrol service can extend the functionality of an automation controlservice developed by such a developer. In certain embodiments, arecommendation can be provided to the developer device 1510 via one ofthe configuration module(s) 1514, and can be generated by arecommendation engine 1570. As illustrated, the usage information can beretained within a repository 1580 (which can be referred to as usageinfo. 1580). As illustrated, in certain embodiments, an analytics engine1590 can process data, metadata, and/or signaling associated withimplementation of one or more automation control services associatedwith a controlled region. Such processing can permit generatingintelligence associated with utilization of the automation controlservice and/or an agent associated therewith. Specifically, yet notexclusively, the analytics engine 1590 can identify or otherwisedetermine patterns and/or othery type of features in time seriesrepresentative or otherwise indicative of the data, metadata, and/orsignaling. In one implementation, the analytics engine 1590 can processthe data, metadata, and/or signaling in nearly real-time. In addition orin other implementations, the analytics engine 1590 can processcontemporaneous and historical information (e.g., data, metadata, and/orsignaling) which can permit identifying or otherwise determininglong-lived (or long time-scale) patterns, such as trends within theinformation.

In addition or in other embodiments, the developer device 1510, via oneof the configuration module(s) 1514, can provide a recommendation to theasset marketplace platform 1526. The recommendation can be provided, forexample, via an API available to the developer device 1510. In oneexample, the recommendation can specify, to the asset marketplaceplatform 1526, one or more service elements or other type of automationcontrol assets that can be utilized by an automation control serviceconfigured by the developer device 1510. In addition or in anotherexample, the recommendation can specify an automation control servicethat can be utilized in conjunction with the automation control serviceconfigured by the developer device 1510.

The API exposure layer 1530 also can provide a group of common APIs thatare not specific to the architecture of a device, sensor, or other typeof agent associated with an automated environment. Accordingly, in oneaspect, the common APIs can permit platform-agnostic development andimplementation of automation control services.

FIG. 18 illustrates an example of an operational environment forimplementation of an automation control service in accordance withaspects of this disclosure. As illustrated, an event and message busarchitecture 1820 can be functionally coupled (e.g., communicativelycoupled to a group of devices 1810 ₁, 1810 ₂, . . . , 1810 _(N-1), and1810 _(N), with N≧1, where one or more of such devices is manufacturedor otherwise provided by a different vendor. Each of the devices 1810₁-1810 _(N) can communicate event information (e.g., data, metadata,and/or signaling) indicative of an event to the bus architecture 1820,which can communicate the information to the event engine 140. Thecommunication can be implemented via one or more common APIs, and anypayload data and/or metadata associated with the event information canbe interpreted using a common information model. As such, the eventengine 140 can receive the event information in a platform-agnosticfashion, and can relay such information to the automation orchestrationplatform 130. The event information can cause the automationorchestration platform 130 to direct the device (e.g., device 1810 ₂)that generated the event information to perform an automation task basedon the event information and according to an automation control serviceassociated with a confined region containing the device 1810 ₁-1810_(N).

FIG. 20 illustrates a block diagram of an example of an operationalenvironment 2000 for customer-centric intelligent automated control inaccordance with one or more aspects of the disclosure. The exampleoperational environment is merely illustrative and is not intended tosuggest or otherwise convey any limitation as to the scope of use orfunctionality of the operating environment's architecture. In addition,the illustrative operational environment 2000 depicted in FIG. 20 shouldnot be interpreted as having any dependency or requirement relating toany one or combination of components illustrated as part of theoperational environment 2000. The operational environment 2000 comprisesa computing device 2010 which, in various embodiments, can correspond tothe computing device 2010.

The operational environment 2000 represents an example implementation ofvarious aspects of the disclosure in which the processing or executionof operations described in connection with customer-centric intelligentautomation control as disclosed herein can be performed in response toexecution of one or more software components at the computing device2010. It should be appreciated that the one or more software componentscan render the computing device 2010, or any other computing device thatcontains such components, a particular machine for customer-centricintelligent automation control as described herein, among otherfunctional purposes. A software component can be embodied in or cancomprise one or more computer-accessible instructions, e.g.,computer-readable and/or computer-executable instructions. In onescenario, at least a portion of the computer-accessible instructions canembody and/or can be executed to perform at least a part of one or moreof the example methods described herein, such as the example methodspresented in FIGS. 21-32. For instance, to embody one such method, atleast a portion of the computer-accessible instructions can be persisted(e.g., stored, made available, or stored and made available) in acomputer storage non-transitory medium and executed by a processor. Theone or more computer-accessible instructions that embody a softwarecomponent can be assembled into one or more program modules that can becompiled, linked, and/or executed at the computing device 2010 or othercomputing devices. Generally, such program modules comprise computercode, routines, programs, objects, components, information structures(e.g., data structures and/or metadata structures), etc., that canperform particular tasks (e.g., one or more operations) in response toexecution by one or more processors, which can be integrated into thecomputing device 2010 or functionally coupled thereto.

The various example embodiments of the disclosure can be operationalwith numerous other general purpose or special purpose computing systemenvironments or configurations. Examples of well-known computingsystems, environments, and/or configurations that can be suitable forimplementation of various aspects of the disclosure in connection withcustomer-centric intelligent automation control as described herein cancomprise personal computers; server computers; laptop devices; handheldcomputing devices, such as mobile tablets; wearable computing devices;and multiprocessor systems. Additional examples can include set-topboxes, programmable consumer electronics, network PCs, minicomputers,mainframe computers, blade computers, programmable logic controllers(PLCs), distributed computing environments that comprise any of theabove systems or devices, or the like.

As illustrated, the computing device 2010 can comprise one or moreprocessors 2014, one or more input/output (I/O) interfaces 2016, one ormore memory devices 2030 (herein referred to generically as memory2030), and a bus architecture 2032 (also termed bus 2032) thatfunctionally couples various functional elements of the computing device2010. In certain embodiments, the computing device 2010 can include,optionally, a radio unit (not depicted in FIG. 20). The radio unit caninclude one or more antennas and a communication processing unit thatcan permit wireless communication between the computing device 2010 andanother device, such as one of the computing device(s) 2070. At leastone of the computing device(s) 2070 can have similar or identicalarchitecture to the computing device 2010. The bus 2032 can include atleast one of a system bus, a memory bus, an address bus, or a messagebus, and can permit exchange of information (data, metadata, and/orsignaling) between the processor(s) 2014, the I/O interface(s) 2016,and/or the memory 2030, or respective functional elements therein. Incertain scenarios, the bus 2032 in conjunction with one or more internalprogramming interfaces 2050 (also referred to as interface(s) 2050) canpermit such exchange of information. In scenarios in which processor(s)2014 include multiple processors, the computing device 2010 can utilizeparallel computing.

The I/O interface(s) 2016 can permit communication of informationbetween the computing device and an external device, such as anothercomputing device, e.g., a network element or an end-user device. Suchcommunication can include direct communication or indirectcommunication, such as exchange of information between the computingdevice 2010 and the external device via a network or elements thereof.As illustrated, the I/O interface(s) 2016 can comprise one or more ofnetwork adapter(s) 2018, peripheral adapter(s) 2022, and renderingunit(s) 2026. Such adapter(s) can permit or facilitate connectivitybetween the external device and one or more of the processor(s) 2014 orthe memory 2030. For example, the peripheral adapter(s) 2022 can includea group of ports, which can comprise at least one of parallel ports,serial ports, Ethernet ports, V.35 ports, or X.21 ports, whereinparallel ports can comprise General Purpose Interface Bus (GPIB),IEEE-1284, while serial ports can include Recommended Standard (RS)-232,V.11, Universal Serial Bus (USB), FireWire or IEEE-1394.

In one aspect, at least one of the network adapter(s) 2018 canfunctionally couple the computing device 2010 to one or more computingdevices 2070 via one or more traffic and signaling pipes 2060 that canpermit or facilitate exchange of traffic 2062 and signaling 2064 betweenthe computing device 2010 and the one or more computing devices 2070.Such network coupling provided at least in part by the at least one ofthe network adapter(s) 2018 can be implemented in a wired environment, awireless environment, or a combination of both. The information that iscommunicated by the at least one of the network adapter(s) 2018 canresult from implementation of one or more operations in a method of thedisclosure. Such output can include any form of visual representation,including, but not limited to, textual, graphical, animation, audio,tactile, or the like. In certain scenarios, each of the computingdevice(s) 2070 can have substantially the same architecture as thecomputing device 2010. In addition, or in the alternative, the renderingunit(s) 2026 can include functional elements (e.g., lights, such aslight-emitting diodes; a display, such as liquid crystal display (LCD),a plasma monitor, a light emitting diode (LED) monitor, anelectrochromic monitor; combinations thereof; or the like) that canpermit control of the operation of the computing device 2010, or canpermit conveying or revealing the operational conditions of thecomputing device 2010.

In one aspect, the bus 2032 represents one or more of several possibletypes of bus structures, including a memory bus or memory controller, aperipheral bus, an accelerated graphics port, and a processor or localbus using any of a variety of bus architectures. As an illustration,such architectures can comprise an Industry Standard Architecture (ISA)bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA (EISA) bus,a Video Electronics Standards Association (VESA) local bus, anAccelerated Graphics Port (AGP) bus, and a Peripheral ComponentInterconnects (PCI) bus, a PCI-Express bus, a Personal Computer MemoryCard Industry Association (PCMCIA) bus, a Universal Serial Bus (USB) andthe like. The bus 2032, and all buses described herein can beimplemented over a wired or wireless network connection and each of thesubsystems, including the processor(s) 2014, the memory 2030 and memoryelements therein, and the I/O interface(s) 2016 can be contained withinone or more remote computing devices 2070 at physically separatelocations, connected through buses of this form, thereby effectivelyimplementing a fully distributed system.

The computing device 2010 can comprise a variety of computer-readablemedia. Computer-readable media can be any available media (transitoryand non-transitory) that can be accessed by a computing device. In oneaspect, computer-readable media can comprise computer non-transitorystorage media (or computer-readable non-transitory storage media) andcommunications media. Example computer-readable non-transitory storagemedia can be any available media that can be accessed by the computingdevice 2010, and can comprise, for example, both volatile andnon-volatile media, and removable and/or non-removable media. In oneaspect, the memory 2030 can comprise computer-readable media in the formof volatile memory, such as random access memory (RAM), and/ornon-volatile memory, such as read-only memory (ROM).

The memory 2030 can comprise functionality instructions storage 2034 andfunctionality information storage 2038. The functionality instructionsstorage 2034 can comprise computer-accessible instructions that, inresponse to execution by at least one of the processor(s) 2014, canimplement one or more of the functionalities of the disclosure. Thecomputer-accessible instructions can embody or can comprise one or moresoftware components illustrated as automation control component(s) 2036.In one scenario, execution of at least one component of the automationcontrol component(s) 2036 can implement one or more of the methodsdescribed herein, such as one or more of the example methods presentedin FIGS. 21-32. For instance, such execution can cause a processor thatexecutes the at least one component to carry out a disclosed examplemethod. It should be appreciated that, in one aspect, a processor of theprocessor(s) 2014 that executes at least one of the automation controlcomponent(s) 2036 can retrieve information from or retain information ina memory element 2040 in the functionality information storage 2038 inorder to operate in accordance with the functionality programmed orotherwise configured by the automation control component(s) 2036. Suchinformation can include at least one of code instructions, informationstructures, or the like. Such instructions and information structurescan embody or can constitute machine-learning techniques (e.g., patternrecognition algorithms, inference algorithms, and the like) that can beutilized to implement at least certain functionality described herein.At least one of the one or more interfaces 2050 (e.g., applicationprogramming interface(s)) can permit or facilitate communication ofinformation between two or more components within the functionalityinstructions storage 2034. The information that is communicated by theat least one interface can result from implementation of one or moreoperations in a method of the disclosure. In certain embodiments, one ormore of the functionality instructions storage 2034 and thefunctionality information storage 2038 can be embodied in or cancomprise removable/non-removable, and/or volatile/non-volatile computerstorage media.

At least a portion of at least one of the automation controlcomponent(s) 2036 or automation control information 2040 can program orotherwise configure one or more of the processors 2014 to operate atleast in accordance with the functionality described herein. In oneembodiment, the automation control component(s) 2036 contained in thefunctionality instruction(s) storage 2034 can include one or morecomponents that can provide the functionality described herein inconnection with customer-centric intelligent automation control. One ormore of the processor(s) 2014 can execute at least one of the automationcontrol component(s) 2036 and leverage at least a portion of theinformation in the functionality information storage 2038 in order toprovide customer-centric intelligent automation control in accordancewith one or more aspects described herein.

It should be appreciated that, in certain scenarios, the functionalityinstruction(s) storage 2034 can embody or can comprise acomputer-readable non-transitory storage medium havingcomputer-accessible instructions that, in response to execution, causeat least one processor (e.g., one or more of processor(s) 2014) toperform a group of operations comprising the operations or blocksdescribed in connection with the disclosed methods.

In addition, the memory 2030 can comprise computer-accessibleinstructions and information (e.g., data and/or metadata) that permit orfacilitate operation and/or administration (e.g., upgrades, softwareinstallation, any other configuration, or the like) of the computingdevice 2010. Accordingly, as illustrated, the memory 2030 can comprise amemory element 2042 (labeled operating system (OS) instruction(s) 2042)that can contain one or more program modules that embody or include oneor more operating systems, such as a Windows operating system, Unix,Linux, Symbian, Android, Chromium, or substantially any OS suitable formobile computing devices or tethered computing devices. In one aspect,the operational and/or architectural complexity of the computing device2010 can dictate a suitable OS. The memory 2030 also comprises a systeminformation storage 2046 having data and/or metadata that permits orfacilitates operation and/or administration of the computing device2010. Elements of the OS instruction(s) 2042 and the system informationstorage 2046 can be accessible or can be operated on by at least one ofthe processor(s) 2014.

It should be recognized that while the functionality instructionsstorage 2034 and other executable program components, such as the OSinstruction(s) 2042, are illustrated herein as discrete blocks, suchsoftware components can reside at various times in different memorycomponents of the computing device 2010, and can be executed by at leastone of the processor(s) 2014. In certain scenarios, an implementation ofthe automation control component(s) 2036 can be retained on ortransmitted across some form of computer-readable media.

The computing device 2010 and/or one of the computing device(s) 2070 caninclude a power supply (not shown), which can power up components orfunctional elements within such devices. The power supply can be arechargeable power supply, e.g., a rechargeable battery, and it caninclude one or more transformers to achieve a power level suitable foroperation of the computing device 2010 and/or one of the computingdevice(s) 2070, and components, functional elements, and relatedcircuitry therein. In certain scenarios, the power supply can beattached to a conventional power grid to recharge and ensure that suchdevices can be operational. In one aspect, the power supply can includean I/O interface (e.g., one of the network adapter(s) 2018) to connectoperationally to the conventional power grid. In another aspect, thepower supply can include an energy conversion component, such as a solarpanel, to provide additional or alternative power resources or autonomyfor the computing device 2010 and/or at least one of the computingdevice(s) 2070.

The computing device 2010 can operate in a networked environment byutilizing connections to one or more remote computing devices 2070. Asan illustration, a remote computing device can be a personal computer, aportable computer, a server, a router, a network computer, a peer deviceor other common network node, and so on. As described herein,connections (physical and/or logical) between the computing device 2010and a computing device of the one or more remote computing devices 2070can be made via one or more traffic and signaling pipes 2060, which cancomprise wireline link(s) and/or wireless link(s) and several networkelements (such as routers or switches, concentrators, servers, and thelike) that form a local area network (LAN) and/or a wide area network(WAN). Such networking environments are conventional and commonplace indwellings, offices, enterprise-wide computer networks, intranets, localarea networks, and wide area networks.

In one or more embodiments, one or more of the disclosed methods can bepracticed in distributed computing environments, such as grid-basedenvironments, where tasks can be performed by remote processing devices(computing device(s) 2070) that are functionally coupled (e.g.,communicatively linked or otherwise coupled) through a network havingtraffic and signaling pipes and related network elements. In adistributed computing environment, in one aspect, one or more softwarecomponents (such as program modules) can be located in both thecomputing device 2010 and at least one remote computing device of thecomputing device(s) 2070, for example. It should be appreciated that insuch distributed environments, the functionality for generation oforganization intelligence and management thereof can be implemented bythe system constituted at least by the computing device 2010 and atleast one of the computing device(s) 2070. Such a system can embody orcan contain at least a portion of the example operational environment100, e.g., the automation orchestration platform 110.

In certain embodiments, such as example embodiment 2000 shown in FIG.20, various features of the embodiments of the disclosure (e.g.,systems, techniques, and the like) can be practiced in distributedcomputing environments, such as grid-based environments, where tasks canbe performed by remote processing devices (computing device(s) 1970)that are functionally coupled (e.g., communicatively linked or otherwisecoupled) through a network having traffic and signaling pipes andrelated network elements. In a distributed computing environment, in oneaspect, one or more software components (such as program modules) can belocated in both a local computing device 1910 and at least one remotecomputing device, such as computing device 2010. As illustrated anddescribed herein, the at least one remote computing device, e.g.,computing device 2010, can have substantially the same architecture andassociated functionality as the computing device 1910. For instance, thecomputing device 2010 can comprise processor(s) 2014, I/O interface(s)2016, and a memory 2030, where a bus architecture can couplefunctionally two or more of such elements. The memory 2030 can comprisea functionality instructions storage 2034 having one or morerepresentation and customization component(s) 2036, and a functionalityinformation storage 2038 having representation and customizationinformation 2040. The memory 2030 also can comprise OS instruction(s)2042 and system information storage 2046 that can permit, at least inpart, operation and/or administration of the computing device 2010. Oneor more internal programming interfaces 2050 (represented asinterface(s) 2050 in FIG. 20) can permit or facilitate exchange ofinformation between the representation and customization component(s)2036 and the functionality information storage 2038. In a scenario inwhich several components are present in the group of representation andcustomization component(s) 2036, at least one interface of theinterface(s) 2050 can permit or facilitate exchange of informationbetween at least two of such components.

In one embodiment, the computing device 1910 and the computing device2010 can embody or can include the exchange component 210 and/orfunctional elements thereof. In another embodiment, the computing device1910 and the computing device 2010 can embody the automationorchestration platform 730 and the development platform 770 (which incertain implementations can include the asset marketplace platform1526).

In view of the aspects described herein, example methods that can beimplemented in accordance with the disclosure can be better appreciatedwith reference to the diagrams in FIGS. 21-32. For purposes ofsimplicity of explanation, the example methods disclosed herein arepresented and described as a series of blocks. However, it is to beunderstood and appreciated that the disclosed methods are not limited bythe order of blocks and associated actions, as some blocks may occur indifferent orders and/or concurrently with other blocks from that shownand described herein. For example, the various methods or processes ofthe disclosure can be alternatively represented as a series ofinterrelated states or events, such as in a state diagram. Furthermore,not all illustrated blocks and associated action(s) may be required toimplement a method in accordance with one or more aspects of thedisclosure. Further yet, two or more of the disclosed methods orprocesses can be implemented in combination with each other, toaccomplish one or more features or advantages described herein. At leasta portion of the methods described herein can be implemented (e.g.,configured (such as linked, compiled, a combination thereof, or thelike); executed; configured and executed; or the like) by a systemhaving at least one processor and at least one information storagedevices (which also may be referred to as at least one memory device orat least one memory). Such a system can comprise one or more computingdevices or one or more processors, and can be employed to executecomputer-accessible instructions retained in a memory, or anycomputer-readable or machine-readable medium, to implement the methodsdescribed herein. The computer-accessible instructions can provide acomputer-executable or machine-executable framework to implement themethods described herein.

It should be further appreciated that the example methods of thedisclosure can be retained on an article of manufacture, orcomputer-readable medium, to permit or otherwise facilitate transportingand transferring such methods to a computing device (e.g., a desktopcomputer, a mobile computer, such as a tablet or a smarphone; a mobiletelephone, a blade computer, a programmable logic controller, and thelike) for execution, and thus implementation, by a processor of thecomputing device or for storage in a memory thereof.

FIG. 21 presents a flowchart of an example method 2100 for generationand/or update of automation control assets and associated control ofdevices in accordance with one or more aspects of the disclosure. In oneembodiment, a system that has at least one processor can implement(e.g., configure, compile, link, execute, combinations thereof, or thelike) one or more blocks of the subject example method. The at least oneprocessor can be functionally coupled to at least one memory devicehaving encoded thereon computer-accessible instructions that representthe subject example method and, in response to execution by the systemor the at least one processor, permit or otherwise facilitateimplementation of the subject example method in part or in its entirety.In additional or alternative embodiments, a computing device that has atleast one processor or is functionally coupled thereto can implement oneor more blocks of the subject example method. The at least one processorcan be functionally coupled to at least one memory device having encodedthereon computer-accessible instructions that represent the subjectexample method and, in response to execution by the system or the atleast one processor, permit or otherwise facilitate implementation ofthe subject example method.

At block 2110, information can be accessed from a group of devicesoperating in a confined region. The devices can include connecteddevices, such as wearable computing devices, mobile computing devices,customer premises equipment; sensors; actuators; motors; equipment withspecific functionality (e.g., a furnace, a water heater, an airconditioner, a compressor, a fan, and so forth). As described herein,the information can include data, metadata, and/or signalingrepresentative of a state or condition of a device in the group ofdevices. In one example, the confined region embodies or includes anautomated environment in which one or more of the group of devices canoperate in accordance with an automation control asset in accordancewith this disclosure. At block 2120, intelligence associated withbehavior of an agent (e.g., an end-user, a device, a sensor, a programin execution, a combination thereof, or the like) within the confinedregion or in proximity to the confined region can be determined. Atblock 2130, an automation control asset can be supplied based at leaston the intelligence determined at block 2120. At block 2140, at leastone device of the group of devices can be directed or otherwiseinstructed to operate based at least on a specific mode of operation ofthe automation control asset.

FIG. 22 presents a flowchart of an example method 2200 for generationand/or update of automation control assets and associated control ofdevices in accordance with one or more aspects of the disclosure. Incertain embodiment, a system that has at least one processor canimplement (e.g., configure, compile, link, execute, combinationsthereof, or the like) one or more blocks of the subject example method.The at least one processor can be functionally coupled to at least onememory device having encoded thereon computer-accessible instructionsthat represent the subject example method and, in response to executionby the system or the at least one processor, permit or otherwisefacilitate implementation of the subject example method in part or inits entirety. In additional or alternative embodiments, a computingdevice that has at least one processor or is functionally coupledthereto can implement one or more blocks of the subject example method.The at least one processor can be functionally coupled to at least onememory device having encoded thereon computer-accessible instructionsthat represent the subject example method and, in response to executionby the system or the at least one processor, permit or otherwisefacilitate implementation of the subject example method.

At block 2210, one or more agents (e.g., device(s), sensor(s), and/orsoftware application(s)) can be identified or otherwise determined forinclusion in an automation control asset. At block 2220, one or morecontrol sequences can be configured for at least one of the agent(s)identified at block 2220. At block 2230, at least one of the controlsequence(s) can be associated with at least one of the agent(s).

FIG. 23 presents a flowchart of an example method 2300 for providing arecommendation for intelligent automation control in accordance with oneor more aspects of the disclosure. In certain embodiments, a system thathas at least one processor can implement (e.g., configure, compile,link, execute, combinations thereof, or the like) one or more blocks ofthe subject example method. The at least one processor can befunctionally coupled to at least one memory device having encodedthereon computer-accessible instructions that represent the subjectexample method and, in response to execution by the system or the atleast one processor, permit or otherwise facilitate implementation ofthe subject example method in part or in its entirety. In additional oralternative embodiments, a computing device that has at least oneprocessor or is functionally coupled thereto can implement one or moreblocks of the subject example method. The at least one processor can befunctionally coupled to at least one memory device having encodedthereon computer-accessible instructions that represent the subjectexample method and, in response to execution by the system or the atleast one processor, permit or otherwise facilitate implementation ofthe subject example method.

At block 2310, an event can be detected. At block 2320, it can bedetermined if the event is a qualified event. In response toascertaining that the event is not a qualified event, flow can bedirected to block 2330, at which exception handling can be performed. Inthe alternative, in response to ascertaining that the event is aqualified event, flow can be directed to block 2340, block 2350, or both(concurrently or sequentially in any order). Specifically, at block2340, a control operation or other type of directive can be recommendedbased at least on one or more of the event or the event strength. Forinstance, the event can be a change in temperature ΔT and the eventstrength can be the magnitude of DT, whether the temperature increases(ΔT>0) or decreases (ΔT<0). At block 2350, an association between two ormore assets can be recommended.

FIG. 24 presents a flowchart of an example method 2400 for configuringhybrid intelligent automation control in accordance with one or moreaspects of the disclosure. In one example, such a type of control canrefer to regulation of an environment via two or more automation controlassets. In certain embodiments, a computing system that has at least oneprocessor can implement (e.g., configure, compile, link, execute,combinations thereof, or the like) one or more blocks of the subjectexample method. The at least one processor can be functionally coupledto at least one memory device having encoded thereon computer-accessibleinstructions that represent the subject example method and, in responseto execution by the system or the at least one processor, permit orotherwise facilitate implementation of the subject example method inpart or in its entirety. In additional or alternative embodiments, acomputing device that has at least one processor or is functionallycoupled thereto can implement one or more blocks of the subject examplemethod. The at least one processor can be functionally coupled to atleast one memory device having encoded thereon computer-accessibleinstructions that represent the subject example method and, in responseto execution by the system or the at least one processor, permit orotherwise facilitate implementation of the subject example method.

At block 2410, an event can be configured as a qualified event. At block2420, the event can be associated with an automation control asset. Atblock 2430, a task to be implemented in response to the qualified eventcan be configured. At block 2440, a second automation control asset canbe identified or otherwise determined to implement the task. At block2450, a configuration of tasks can be generated, where such aconfiguration can include detection of the event by the automationcontrol asset and implementation of the task by the second automationcontrol asset.

FIG. 25 presents a flowchart of an example method 2500 for implementinghybrid automation control in accordance with one or more aspects of thedisclosure. In certain embodiments, the system or computing device thatimplements the example method 2000 also can implement the subjectexample method. At block 2505, an event can be detected. At block 2510,it can be determined if the event is a qualified event. In response toascertaining that the event is not a qualified event, exception handlingcan be implemented at block 2515. In the alternative, in response toascertaining that the event is a qualified event, an automation controlasset associated with the event can be identified or otherwisedetermined. At block 2525, it can be determined if the automationcontrol asset is in operation. In response to ascertaining that theautomation control asset is not in operation, exception handling can beimplemented at block 2530. In certain embodiments, implementingexception handling can include implementing (e.g., executing) theautomation control asset. In addition or in other embodiments,implementing exception handling can include communicating arecommendation for the automation control asset. In the alternative, inresponse to ascertaining that the automation control asset is inoperation, a second automation control asset can be identified orotherwise determined at block 2535. In one aspect, the second automationcontrol asset can be configured to implement a task in response to theevent (which has been determined to be a qualified event).

At block 2540, it can be determined if the second automation controlasset is available. Availability of such an asset can be determined byavailability of a subscription or other type of affirmative entitlementto the second automation control asset by a party (e.g., an end-user ora consumer) associated with an environment (e.g., the confined region104 or the confined region 710). In response to ascertaining that thesecond automation control asset is not available, a recommendation forsuch an asset can be communicated at block 2545. In the alternative, inresponse to ascertaining that the second automation control asset isavailable, it can be determined, at block 2550, if the second automationcontrol asset is in operation. In response to ascertaining that such anasset is not in operation, the second automation control asset can beimplemented at block 2555. Implementation of the second automationcontrol asset can include manipulation of one or more agents associatedwith the asset, such as execution of a software application, datacollection by one or more sensors, and/or initialization of one or moredevices. As such, the implementation of the second automation controlasset can cause such an asset to be in operation. In the alternative, inresponse to ascertaining that the second automation control asset is inoperation, such an asset can be directed or otherwise instructed, atblock 2560, to implement the task responsive to the event detected atblock 2505.

FIG. 26 presents a flowchart of an example method 2600 for devicediscovery and configuration in accordance with one or more aspects ofthe disclosure. In certain embodiments, the subject example method canbe implemented by a computing device, such as a gateway device inaccordance with aspects of the disclosure. At block 2610, a device canbe discovered. At block 2620, a request to configure the device toreceive operation directives can be communicated or otherwisetransmitted to a remote computing device. In one aspect, one or more ofthe operation directives can be determined by a mode of an automationcontrol asset. At block 2630, a response to the request can be received.The computing device (e.g., gateway 112) can receive the response. Atblock 2640, the device can be mapped to an automation control asset. Inone example, mapping the device can include generating a device profilethat includes information indicative of the association between thedevice and the automation control asset.

FIG. 27 presents a process flow of an example method 2700 for devicediscovery and configuration in accordance with one or more aspects ofthe disclosure. As illustrated, the example process flow can beimplemented in a distributed arrangement in which several functionalelements communicate information and process such information. Morespecifically, in one aspect, a gateway device 2704 can exchangediscovery signaling 2708 (e.g., handshake signaling) with one or moredevices 2702. In one aspect, at least a portion of the discoverysignaling can permit the gateway device 2704 to identify at least one ofthe device(s) 2702. Identification of the device can include informationindicative of one or more of a device identity, a device type, a devicefunctionality, a combination thereof, or the like. In addition, thediscovery signal can convey a current association between the at leastone device and one or more automation control assets. The gateway device2704 can communicate a configuration request 2710 to an orchestrationplatform 2706. The configuration request 2710 can be directed toconfiguration of the at least one device of the device(s) 2704 tooperate in accordance with an automation control asset, which can beadministered by the orchestration platform 2706. The configurationrequest 2710 can include, for example, information indicative of alocation of the at least one device; information indicative of a type ofthe at least one device; information indicative of the sensitivity ofthe at least one device; access rights (such an entitlement) to the atleast one device by a party associated with the at least one device, acombination thereof, or the like.

In response to the configuration request 2712, the orchestrationplatform 2706, or a component therein, can configure the at least onedevice of the device(s) 2702 to receive control tasks or otherdirectives associated with an automation control asset. In thealternative, the orchestration platform 2706 can reject or otherwisedecline the configuration request 2710. In any case, the orchestrationplatform 2706 can communicate a configuration response 2712 to thegateway device 2704.

The gateway device 2704 can receive the configuration response 2712 and,in response, can provide an authorization request 2713 to publish thediscovery of the configured device(s). As illustrated, the authorizationrequest 2713 can be transmitted to a user device 2705 that can beoperated by an end-user or other party associated with a confined regionincluding the device(s) 2702. The user device 2705 can provide anauthorization request 2714 to the gateway device 27040. For instance theauthorization request 2714 can permit or decline broadcast of thediscovered device(s) by the gateway device 2704 or the orchestrationplatform 2706. As such, presentation of a discovered device associatedwith the confined region can be administered by an end-user, forexample.

In addition, based on the response, the gateway device 2704 candetermine if a device associated with the configuration request 2710 hasbeen configured, by the orchestration platform 2706, to receive controltasks or directives associated with an automation control asset. Inresponse to ascertaining that the device has not been so configured, thegateway device can implement an exception at block 2716. In thealternative, in response to ascertaining that the device has beenconfigured to receive such control tasks or directives, the gatewaydevice 2704 can map the device to the automation control asset at block2718. In addition, the gateway device 2704 can convey information 2720indicative or otherwise representative of the mapping to theorchestration platform 2706.

Subsequent to configuration and mapping, the gateway device 2704 and theorchestration platform 2706 can exchange an automation sequence 2722,and based on such a sequence, the gateway device 2704 and at least oneconfigured and mapped device of the device(s) 2702 can exchange anautomation sequence 2724. Each of such automation sequences can includedata, metadata, and/or signaling that permits implementation of one ormore automation tasks associated with the automation control asset.

FIG. 28 presents a flowchart of an example method 2800 for developing orotherwise configuring automation control assets according to one or moreaspects of the disclosure. In certain embodiments, a computing systemhaving one or more processors functionally coupled to one or more memorydevices can implement at least a portion of the subject example method.In one example, such a computing system can embody or can include thedevelopment platform 770. At block 2810, a premises framework can beselected. The premises framework embodies or includes a framework for anenvironment to be automated. As described herein, in one example, theenvironment can include a confined region and one or more agents to beautomated and controlled. As such, in certain embodiments, the premisesframework can include a single unit dwelling (SUD) framework, amultiple-dwelling unit (MDU) framework, a business framework, a factoryframework, or the like. At block 2820, an activity framework can beselected. The activity framework can represent a category offunctionality of the environment to be automated. A category offunctionality can include, for example, music or sound, lighting,temperature, motion, physical access, and the like. More specifically,yet not exclusively, the activity framework can represent one or moreautomation control tasks that can be implemented within the environment.At block 2830, one or more automation control tasks (which also may bereferred to as automation tasks) can be configured using or otherwiserelying at least on one or more of the premises framework or theactivity framework. At block 2840, it can be determined if an additionalautomation task is to be configured. In response to ascertaining thatthe additional automation task is to be configured, the flow of thesubject example method can be directed to block 2820. In the alternativeor in other embodiments, the flow can be directed to block 2850, anoptional block at which a recommendation for an automation task, anautomation control service element, and/or an automation control servicecan be received. At block 2860, one or more of the recommended serviceor a service including the configured automation control tasks can beconfigured.

FIG. 29 presents a flowchart of an example method 2900 for developing orotherwise configuring an automation control asset in accordance with oneor more aspects of the disclosure. In certain embodiments, a computingsystem having one or more processors functionally coupled to one or morememory devices can implement at least a portion of the subject examplemethod. In one example, such a computing system can embody or caninclude the development platform 770. At block 2910, an automationcontrol service can be defined according to a service schema. Asdescribed herein, the service schema can be embodied in or can include aXML schema and/or UML schema, such as the example schema illustrated inFIGS. 18A-18B. At block 2920, the automation control service can besupplied to a service inventory. At block 2930, an automation controlservice element of the automation control service can be supplied to theservice inventory. In one aspect, the automation control service elementcan be supplied to a service element inventory that can be included orotherwise associated with the service inventory. At block 2940, aservice capability of the automation control service can be supplied tothe service inventory. In one aspect, the service capability can besupplied to a service capability inventory included or otherwiseassociated with the service inventory. At block 2950, an elementcapability of the automation control service element can be supplied tothe service inventory. In one aspect, the element capability can besupplied to an element capability inventory included or otherwiseassociated with the service inventory. In certain embodiments, theservice inventory can be embodied in a relational database retained in arepository (e.g., one or more memory devices) according to an inventoryschema. The relational database can include tables that embody,respectively, the service element inventory, the service capabilityinventory, and the element capability inventory.

FIG. 30 presents a flowchart of an example method 3000 for developing anautomation control asset in accordance with one or more aspects of thedisclosure. In certain embodiments, a computing system having one ormore processors functionally coupled to one or more memory devices canimplement at least a portion of the subject example method. In oneexample, such a computing system can embody or can include thedevelopment platform 770. At block 3010, an asset representation of eachof a group of automation control assets can be provided. As describedherein, in certain embodiments, such a representation can be embodied inan XML schema and can be implementation-agnostic. At block 3020, aninformation model for each of a group of automation control assets canbe provided. In certain embodiments, such a model can be embodied in orcan include a UML schema. At block 3030, a common control language foreach of the group of automation control assets can be provided. At block3040, an automation control asset based at least on the assetrepresentation, the information model, and the common control language.At block 3040, an automation control service comprising the generatedautomation control asset can be generated as described herein.

In certain embodiments, the example method 300 can include one or moreblocks at which an input message from an agent associated with anoperational environment controlled via the automation control servicecan be received; the input message is mapped to a control message basedon the common control language; a control action for the agent based atleast on the control message is determined; and the agent can bedirected to execute the control action) or control operation).

In addition or in other embodiments, the subject example method caninclude a block at which availability of at least one of the generatedautomation control asset or the generated automation control service canbe communicated. For instance, such availability can be communicated toa remote computing device

Further or in yet other embodiments, the subject example method caninclude a block at which a recommendation for an automation controlservice based at least on a group of extant automation control servicescan be provided. In addition or in the alternative, the subject examplemethod can include a block at which a recommendation for an automationcontrol asset based at least on a group of extant automation controlassets can be provided.

In certain embodiments, the subject example method can include a blockat which a group of agents associated with automation control of anoperational environment can be determined or otherwise identified basedon at least one of (i) provisioning an automation control service forthe operational environment, or (ii) detecting a change in theoperational environment. In addition, in one embodiments, the subjectexample method can include a block at which an inventory of thedetermined group of agents can be determined. In one aspect, the groupof agents comprises one or more of an automation control service, anautomation control asset, an electronic device, a sensor, or a networkservice. In another aspect, an information structure representative ofthe generated inventory can be generated, wherein the informationstructure conveys relationships among agents in the group of agents. Inyet another aspect, the subject example method can include a block atwhich at least a portion of the generated inventory can be provided. Forinstance, the computing system that implements the subject examplemethod can provide (e.g., transmit or otherwise communicate) thegenerated inventory as an extensive markup language (XML) schema.

In certain embodiments, the subject example method also can include ablock at which an automation control asset can be generated based atleast in part on at least the portion of the generated inventory.

At block 2960, usage information related to operation of a group ofdevices within a confined region can be optionally accessed. At block2970, one or more associations between a trigger event and a controlevent based at least on the automation control service and the usageinformation that may be accessed.

FIGS. 31-33 present examples of methods 3100, 3200, and 3300,respectively, for adaptation of an automation control service inaccordance with aspects of the present disclosure. Similarly to othermethods described herein, in certain embodiments, a computing systemthat has at least one processor can implement (e.g., configure, compile,link, execute, combinations thereof, or the like) one or more blocks ofeach of these example methods. The at least one processor can befunctionally coupled to at least one memory device having encodedthereon computer-accessible instructions that represent the subjectexample method and, in response to execution by the system or the atleast one processor, permit or otherwise facilitate implementation ofeach of the subject example methods in part or in its entirety. Inaddition or alternative embodiments, a computing device that has atleast one processor or is functionally coupled thereto can implement oneor more blocks of the subject example method. The at least one processorcan be functionally coupled to at least one memory device having encodedthereon computer-accessible instructions that represent the subjectexample method and, in response to execution by the system or the atleast one processor, permit or otherwise facilitate implementation ofthe subject example method.

Regarding example method 3100, at block 3110, one or more automationcontrol services can be executed. At block 3120, information from agroup of agents associated with an operational environment (e.g., asingle family residence, a multiple-dwelling residence, or a SMB) can beaccessed. At block 3130, an environment condition of the operationalenvironment can be determined using at least a portion of theinformation. At block 3140, a state of an agent of the group of agentcan be determined using at least a second portion of the information. Atblock 3150, at least one of the one or more automation control servicescan be adjusted based at least on one or more of the environmentcondition or the state.

In connection with example method 3200, at block 3210, one or moreautomation control services can be executed. At block 3220, informationfrom a group of agents associated with an operational environment can beaccessed. At block 3230, intelligence representative of a behavior of atleast one agent of the group of agents can be determined based at leaston a portion of the information. At block 3240, historical conditions ofthe operational environment can be determined based at least on a secondportion of the information. At block 3250, an environment condition ofthe operational environment can be predicted based at least on thehistorical conditions. At block 3260, a state of an agent of the groupof agents can be predicted based at least on the intelligence. At block3270, at least one of the executed automation control service(s) can beadjusted based at least on one or more of the predicted environmentcondition or the state.

Regarding example method 3300, at block 3310, information from a groupof agents associated with an operational environment can be accessed. Atblock 3320, intelligence associated with interactivity of at least oneagent of the group of agents can be determined. The interactivity canrepresent, for example, interaction(s) of the at least one agent withanother agent. In another example, the interactivity can representinteraction(s) of the at least one agent with an end-user (e.g., anoccupant of the operational environment). At block 3330, arecommendation for an automation control service for the operationalenvironment can be supplied based at least on the intelligence.

As it would readily appreciated, various embodiments of the disclosuremay take the form of an entirely or partially hardware embodiment, anentirely or partially software embodiment, or a combination of softwareand hardware (e.g., a firmware embodiment). Furthermore, as describedherein, various embodiments of the disclosure (e.g., methods andsystems) may take the form of a computer program product comprising acomputer-readable non-transitory storage medium havingmachine-accessible instructions (e.g., computer-readable and/orcomputer-executable instructions) such as computer software, encoded orotherwise embodied in such storage medium. Those instructions can beread or otherwise accessed and executed by one or more processors toperform or permit performance of the operations described herein. Theinstructions can be provided in any suitable form, such as source code,compiled code, interpreted code, executable code, static code, dynamiccode, assembler code, combinations of the foregoing, and the like. Anysuitable computer-readable non-transitory storage medium may be utilizedto form the computer program product. For instance, thecomputer-readable medium may include any tangible non-transitory mediumfor storing information in a form readable or otherwise accessible byone or more computers or processor(s) functionally coupled thereto.Non-transitory storage media can include read-only memory (ROM); randomaccess memory (RAM); magnetic disk storage media; optical storage media;flash memory, etc.

At least some embodiments of the techniques in accordance with thedisclosure are described with reference to block diagrams and flowchartillustrations of methods, computing devices, apparatuses and/or computerprogram products. It can be understood that each block of the blockdiagrams and flowchart illustrations, and combinations of blocks in theblock diagrams and flowchart illustrations, respectively, can beimplemented by machine-accessible instructions. In certainimplementations (such as in the example computing environment describedin connection with FIG. 20) the machine-accessible instructions may beloaded or otherwise incorporated into a general purpose computer,special purpose computer, or other programmable information processingapparatus to produce a particular machine, such that at least some orall of the operations or functions specified in the flowchart block orblocks can be implemented in response to execution at the computer orprocessing apparatus.

As it is employed in the subject disclosure, the term “processor” canrefer to substantially any computing processing unit or devicecomprising, but not limited to comprising, single-core processors;single-processors with software multithread execution capability;multi-core processors; multi-core processors with software multithreadexecution capability; multi-core processors with hardware multithreadtechnology; parallel platforms; and parallel platforms with distributedshared memory. Additionally, a processor can refer to an integratedcircuit, an application specific integrated circuit (ASIC), a digitalsignal processor (DSP), a field programmable gate array (FPGA), aprogrammable logic controller (PLC), a complex programmable logic device(CPLD), a discrete gate or transistor logic, discrete hardwarecomponents, or any combination thereof designed to perform the functionsdescribed herein. Processors can exploit nano-scale architectures suchas, but not limited to, molecular and quantum-dot based transistors,switches and gates, in order to optimize space usage or enhanceperformance of user equipment. A processor may also be implemented as acombination of computing processing units.

In the subject specification and annexed drawings, terms such as“store,” “data store,” “data storage,” “database,” “repository,” andsubstantially any other information storage component relevant tooperation and functionality of a component, refer to “memorycomponents,” or entities embodied in a “memory” or components comprisingthe memory. It will be appreciated that the memory components describedherein can be either volatile memory or nonvolatile memory, or caninclude both volatile and nonvolatile memory. In addition, memoryelements described herein can be affixed, removable, or a combinationthereof.

By way of illustration, and not limitation, nonvolatile memory caninclude read only memory (ROM), programmable ROM (PROM), electricallyprogrammable ROM (EPROM), electrically erasable ROM (EEPROM), or flashmemory. Volatile memory can include random access memory (RAM), whichacts as external cache memory. By way of illustration and notlimitation, RAM is available in many forms such as synchronous RAM(SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rateSDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), anddirect Rambus RAM (DRRAM). Additionally, the disclosed memory componentsof systems or methods herein are intended to comprise, without beinglimited to comprising, these and any other suitable types of memory.

Unless otherwise expressly stated, it is in no way intended that anytechnique, protocol, procedure, process, or method set forth herein beconstrued as requiring that its acts or steps be performed in a specificorder. Accordingly, where a process or method claim does not actuallyrecite an order to be followed by its acts or steps or it is nototherwise specifically recited in the claims or descriptions of thesubject disclosure that the steps are to be limited to a specific order,it is no way intended that an order be inferred, in any respect. Thisholds for any possible non-express basis for interpretation, including:matters of logic with respect to arrangement of steps or operationalflow; plain meaning derived from grammatical organization orpunctuation; the number or type of embodiments described in thespecification or annexed drawings, or the like.

What has been described herein in the present specification and drawingsincludes examples of systems, devices, and techniques that can providecustomer-centric intelligent automation control for device(s) and/orsensor(s). It is, of course, not possible to describe every conceivablecombination of components and/or methodologies for purposes ofdescribing the various features of the disclosure, but one of ordinaryskill in the art can recognize that many further combinations andpermutations of the claimed subject matter are possible. Accordingly, itmay be apparent that various modifications and/or variations can be madeto the disclosure without departing from the scope or spirit thereof. Inaddition or in the alternative, other embodiments of the disclosure maybe apparent from consideration of the specification and annexeddrawings, and practice of the disclosure as presented herein. It isintended that the examples put forward in the specification and annexeddrawings be considered, in all respects, as illustrative and notrestrictive.

What is claimed is:
 1. A method for automation control comprising:accessing, by a computing system comprising at least one memory deviceand at least one processor, one or more information streams from a groupof agents associated with an operational environment; determining, bythe computing system and based on at least one of the one or moreinformation streams, intelligence associated with behavior of an agentof the group of agents or in proximity to the operational environment;and determining, by the computing system, a control operation based atleast on the determined intelligence, the control operation beingassociated with an automation control asset configured to regulate of atleast one agent of the group of agents.
 2. The method of claim 1,wherein the group of agents comprises a group of devices, and whereinthe accessing comprises monitoring, by the computing system, operationalactivity at one or more of the group of devices, wherein the group ofdevices comprises at least one of customer premises equipment, atransducer, a sensor, a medical device, a three-dimensional printer, adetector, a scanner, a code-reader device, a radiofrequencyidentification device (RFID) reader, a controller, a telecommunicationreceiver, a telecommunication transmitter, a telecommunicationtransceiver, a tethered computing device, a wireless computing device, awearable device, or an appliance.
 3. The method of claim 1, furthercomprising grouping, by the computing system, the determined controloperation into an automation mode of the automation control asset,wherein the automation control asset comprises at least one automationmode, each automation mode comprising a configuration of tasks for theat least one agent.
 4. The method of claim 3, further comprisingdirecting at least one agent of the group of agents to operate based atleast on the automation mode.
 5. The method of claim 4, wherein thedirecting comprises one or more of selecting, by the computing system,the at least one agent, or determining, by the computing system, anagent to be added to the group of agents.
 6. The method of claim 3,wherein the grouping comprises updating, by the computing system, atleast one configuration of tasks for the at least one agent.
 7. Themethod of claim 3, wherein the grouping comprises generating, by thecomputing system, a new configuration of tasks associated with the atleast one automation mode.
 8. The method of claim 1, wherein thesupplying comprises determining, by the computing system, a firstconfiguration of tasks for at least one device of the group of devicesbased on a second configuration of tasks associated with a secondautomation control asset.
 9. The method of claim 1, wherein determining,by the computing system, the intelligence comprises generating, by thecomputing system, a model of the behavior of the agent based at least onunsupervised learning, wherein the model comprises one or more ofstatistical Markov model, a neural network model, or a Gaussian mixturemodel.
 10. The method of claim 1, wherein determining, by the computingsystem, the intelligence comprises generating, by the computing system,a model of the behavior of the agent based at least on supervisedlearning, wherein the model comprises one or more of statistical Bayesmodel, a neural network model, or regression analysis.
 11. The method ofclaim 1, wherein determining, by the computing system, the intelligencecomprises determining a correlation between events associated with atleast one second agent of the group of agents, the at least one secondagent being in at least one of (i) a specific control state of a controlsequence based on the automation control service or (ii) a specificagent state.
 12. The method of claim 1, wherein the determining, by thecomputing system, the intelligence comprises determining a pattern ofevents associated with the agent, the pattern comprising one or more of(i) a pattern of sequences of events, (ii) a time-domain pattern in theat least one of the one or more information streams, or (iii) aspace-domain pattern in the at least one of the one or more informationstreams; or determining correlations between patterns in the at leastone of the one or more information streams.
 13. A system, comprising: atleast one memory device having instructions encoded thereon; and atleast one processor coupled to the at least memory device and configuredto execute the instructions and, in response, further configured atleast to: access one or more information streams from a group of agentsassociated with an operational environment; determine intelligenceassociated with behavior of an agent of the group of agents or inproximity to the operational environment; and determine a controloperation based at least on the determined intelligence, the controloperation being associated with an automation control asset configuredto regulate of at least one agent of the group of agents.
 14. The systemof claim 13, wherein the group of agents comprises a group of devices,and wherein the accessing comprises monitoring, by the at least onprocessor, operational activity at one or more of the group of devices,wherein the group of devices comprises at least one of customer premisesequipment, a transducer, a sensor, a medical device, a three-dimensionalprinter, a detector, a scanner, a code-reader device, a radiofrequencyidentification device (RFID) reader, a controller, a telecommunicationreceiver, a telecommunication transmitter, a telecommunicationtransceiver, a tethered computing device, a wireless computing device, awearable device, or an appliance.
 15. The system of claim 13, whereinthe at least one processor is further configured, in response toexecution of the instructions, to group the determined control operationinto an automation mode of the automation control asset, wherein theautomation control asset comprises at least one automation mode, eachautomation mode comprising a configuration of tasks for the at least oneagent.
 16. The system of claim 15, wherein the at least one processor isfurther configured, in response to execution of the instructions, todirect at least one agent of the group of agents to operate based atleast on the automation mode.
 17. The system of claim 16, wherein the atleast one processor is configured, in response to execution of theinstructions, to: direct further comprises one or more of select the atleast one agent, or determine an agent to be added to the group ofagents.
 18. The system of claim 15, wherein the at least one processoris configured, in response to execution of the instructions, to groupfurther comprises to update at least one configuration of tasks for theat least one agent.
 19. The system of claim 15, wherein the at least oneprocessor is configured, in response to execution of the instructions,to group further comprises to generate a new configuration of tasksassociated with the at least one automation mode.
 20. The system ofclaim 13, wherein to supply further comprises to determine a firstconfiguration of tasks for at least one device of the group of devicesbased on a second configuration of tasks associated with a secondautomation control asset.
 21. The system of claim 13, wherein todetermine the intelligence further comprises to generate a model of thebehavior of the agent based at least on unsupervised learning, whereinthe model comprises one or more of statistical Markov model, a neuralnetwork model, or a Gaussian mixture model.
 22. The system of claim 13,wherein to determine the intelligence further comprises to generate amodel of the behavior of the agent based at least on supervisedlearning, wherein the model comprises one or more of statistical Bayesmodel, a neural network model, or regression analysis.
 23. The system ofclaim 13, wherein to determine the intelligence further comprises todetermine a correlation between events associated with at least onesecond agent of the group of agents, the at least one second agent beingin at least one of (i) a specific control state of a control sequencebased on the automation control service or (ii) a specific agent state.24. The system of claim 13, wherein to determine the intelligencefurther comprise to: determine a pattern of events associated with theagent, the pattern comprising one or more of (i) a pattern of sequencesof events, (ii) a time-domain pattern in the at least one of the one ormore information streams, or (iii) a space-domain pattern in the atleast one of the one or more information streams; or determinecorrelations between patterns in the at least one of the one or moreinformation streams.